How to load multiple sheets of an Excel File in SSIS

Source Files

For demonstration purpose, I have an Excel file which is containing sales data monthly. Each sheet contains data per month. 
 

Development environment

• SQL Server 2014 Developer Edition ( or SQL Server 2014 Express)
• SQL Server Data Tools for Visual Studio 2013
• Excel 2010 (32 bits)

Click here to download SQL Server and SQL Server Data Tools

If you could not install any Excel instance of Microsoft, you can download Microsoft Access Database Engine (choose 32 or 64 bit).
 

Develop SSIS package

Step 1 - Create a folder to store Excel file

Step 2 - Create Excel example file

The Excel file contain sales data from October to December in 2015 and there are 3 sheets of three months. They have same structure.
 

Step 3 - Create a staging table in SQL Database Server

USE Demo
                      GO
                      CREATE TABLE Stg_SalesDataInMutipleSheets
                      (
                      TransactionDate date,
                      ProductCategory nvarchar(50),
                      ProductSubCategory nvarchar(50),
                      ProductName nvarchar(100),
                      Price decimal,
                      Quantity int,
                      TotalAmount decimal
                      )
                      

Select all Open in new window

Step 4 - Create SSIS package

4.1 Create a new SSIS project and then a new SSIS loader with name AA_LoadSalesData_Monthly

4.2 Create variables for the package
Because we need to pass the folder path / file name dynamically, we need to create some variables:

OLEDBConnectionString: connection string to SQL Database Server
Value: Data Source=HSSSC1PCL01198\SQLSERVER2014; Initial Catalog=Demo;Provider=SQLNCLI11.1;Integrated Security=SSPI;
Data Source: database server name
Initial Catalog: database name
Provider: the driver to connect to SQL Database Server. You need to change the value to meet your environment. I use SQLNCLI11.1 because SQL Server Engine is 2014. If your version is lower than SQL 2012 version, it should be 10.0 / 10.1
Integrated Security: means that I use Window Authentication mode while connection to SQL Database Server.

SourcePath: path to folder which contains our Excel files
Value: D:\SSIS-Practice\Load_Multiple_Sheets\Source_Files

ExcelFile: Excel file name. By default, we assign path of example file.
Value: D:\SSIS-Practice\Load_Multiple_Sheets\Source_Files\AA_Sales_Data_2015.xlsx

SheetName: contains name of each sheet in Excel file. When SSIS package reads Excel file, it will scan every sheet and get sheet name, and then assign the value to this variable. Assign Sheet1$ by default.

4.3 Create Connection Configurations
SSIS package uses the connection configurations to make connection, which we create them in Connection Manager pane.
Create OLEDB Connection and assign OLEDBConnectionString variable to ConnectionString property.

Create Excel Connection and assign ExcelFile variable to ServerName property



4.3 Define control flow
4.3.1 Drag and drop Execute SQL Task to truncate table Stg_SalesDataInMutipleSheets

4.3.2 Drag and drop Foreach Loop Container component. Double click to open Foreach Loop editor.
On Collection

Configure ADO.NET Connection Manager window appears, then we click on New button. Connection Manager window appears, select Microsoft Office 12.0 Access Database Engine OLE DB Provider. Because the Excel file is 2007 (xlsx format), we need to select this option. If Excel is lower version such as 2003 Excel, we select Microsoft Jet 4.0 OLE DB Provider.

Enter path of Excel example file for Server or file name 

Click on All tab, then enter EXCEL 12.0 value for Extend Properties. And then click on Test Connection to make sure that SSIS can connect to Excel file. In case, you select Microsoft Jet 4.9 OLE DB Provider, please enter EXCEL 8.0 instead of EXCEL 12.0

Click OK to back Foreach Loop Editor window. Select Tables for Schema


On Variable Mapping, we have setup the variable mapping with SheetName variable to index 2

On Connection Manage pane, a new connection is appeared. Change name it as Schema
​

4.3.3 Verify sheet name
Sometimes, Excel file includes some invalid sheet name so we need additional step to verify before loading data. Remember we name sheet as AA-<month name>
Drag and drop Script Task component into Foreach Loop Container. Double click to open Script Task Editor then select as below

Click on Edit Script button and add the C# code to verify sheet name

public void Main()
                      {
                                   // TODO: Add your code here
                      
                                 Dts.TaskResult = (int)ScriptResults.Success;
                                 String sheetname = Dts.Variables["User::SheetName"].Value.ToString();
                                 try
                                  {
                                      if (sheetname.Trim().Contains("AA-"))
                                      {
                                          Dts.Variables["User::IsValidateSheetName"].Value = true;
                                      }
                                      else
                                      {
                                          Dts.Variables["User::IsValidateSheetName"].Value = false;
                                      }
                                  }
                                  catch
                                  {
                                      Dts.Variables["User::IsValidateSheetName"].Value = false;
                                  }
                      }
                      

Select all Open in new window

​
4.4 Define Data Flow 
Drag and drop Data Flow Task component into Foreach Loop Container. Data Flow loads data from each sheet to staging table. Connect Task Script with Data Flow and double-click on line connector to open Precedence Constraint Editor. We only load valid sheets based on user define variable  IsValidateSheetName
Double click on Data Flow Task.


4.4.1 Define Excel Source
Drag and drop Excel Source component. Double click to open Excel Source Editor.
On Connection Manger tab







On Column table: select columns we want to transfer data. In this example, we select all columns.





4.4.2 Define OLE DB Destination
Drag and drop OLE DB Destination component and double-click to open OLE DB Destination Editor
On Connection Manager:






On Mappings: map Input Columns and Destination Columns





Finally, we have SSIS package as below

Run package

Press F5 to execute SSIS package
Check data to make sure that they are inserted into the table successfully. There are 30 rows in result.

 

Conclusions

The above package is very simple. Obviously, we will have many steps when we implement it in any real project. The purpose is to give you the solution in case you have to load data of multiple sheets of an Excel file. One of critical issues is Excel connection, maybe you will face to it. Make sure that you have Excel installed or you must install Database Engine, which I mentioned earlier.