SQL Server Video to Pre-Validate Data with PowerShell Before Importing

By:   |   Updated: 2014-07-29   |   Comments   |   Related: More > Import and Export


Enter your business email address to
get free SQL Server tips.

Problem / Solution

One issue with importing data into SQL Server is that the import file has rows that have too many or too few columns and therefore the imported data doesn't insert correctly or doesn't import at all.  With small files this is easy to manually correct prior to import, but what about files with thousand or millions of rows?  In this video tip, we look at how to use PowerShell to remove the bad records so the import process can function without issue.

Key Learning Items
  • The import behavior of BULK INSERT when there are too few or too many delimiters in a line.
  • PowerShell script to automate removing invalid lines.
  • Reminder of why logging good data is important.
Read Companion Tip

Click Here

Last Updated: 2014-07-29

get scripts

next tip button

About the author
MSSQLTips author Tim Smith Tim Smith works as a DBA and developer and also teaches Automating ETL on Udemy.

View all my tips

Comments For This Article


Recommended Reading

Using OPENROWSET to read large files into SQL Server

Simple Image Import and Export Using T-SQL for SQL Server

How to Copy a Table in SQL Server to Another Database

Bulk Insert Data into SQL Server

SQL Server Bulk Insert for Multiple CSV Files from a Single Folder

get free sql tips
agree to terms