SSIS Tutorial : The SQL Server Integration Services, shortly called as SSIS is a powerful ETL tool. This SSIS tutorial covers all the topics on Connection Managers, Data Sources, Transformations, Control Flow, and Data flow tasks. SSIS ETL tool Extracts data from different sources and Transform that Data as per user requirements and Load data into various destinations.
Remember, it is the second-largest tool to perform Extraction, Transformation, and Load (ETL process) operations. Although it is the most powerful tool, you can easily learn SSIS tutorial in 28days (Maximum).
SSIS ETL tool helps to build enterprise level data transformation and data integration solutions. This ETL tool is beneficial in loading data from regular transactional data into Data Warehouse. So that you can create reports using that data with the help of SSRS, Tableau, etc. Apart from the Data Warehouse application, you can also use SQL Server Integration Services to work on typical data integration applications. Before you start learning the SSIS tutorial, I suggest you learn SQL Server basics, at least SELECT Statements.
SSIS Tutorial Introduction
The Microsoft SQL Server Integration Services or SSIS included many built-in tasks and transformations to solve complex business problems by building high performance data integration packages. You can use SQL SSIS for updating warehouses, data mining, downloading or copying files, extract and transfer data from XML to SQL, etc. To develop or create an integration packages, you need SQL Data Tools or BIDS. I suggest you install the SQL Data Tools, Visual studio or Business Intelligence Development Studio (BIDS) to practice this SSIS tutorial.
- What is SQL Server Integration Services
- Install SQL Server Data Tools or BIDS
- Create a New Integration Services Project
- Create a New Package
SSIS Tutorial on Data Flow
There are three types of SQL Integration Services data flow components: Sources, Transformations, and Destinations. Each data flow component has an output. Use the output to connect with other components. For instance, connect the source output to transformations and then connect transformation output to destination.
While working with the SSIS tutorial on data flow components, you always have to check the columns mappings, and this is a place whether you might end up with errors. I mean wrong column mapping or no column mapping, etc.
NOTE: I suggest you download Adventure Works, and Adventure works DW databases to practice the examples of this SSIS tutorial. Because we use these two databases in this entire SSIS tutorial. Please refer to Install Adventure Work and SELECT Statements in SQL Server.
SSIS Tutorial on Connection Managers
The connection manager contains the physical connection string properties that will create or establish a connection at a run time. SQL Integration Services allows us to develop both the project level and package level connection managers.
The project level connection managers shared among all the packages in that project. It is available at the project deployment. This section of SSIS tutorial covers establishing connections between this SQL SSIS and different data sources.
Learn everything about SSIS Connection Managers tutorial in the First two days. Generally, it takes one day to cover this topic. Most of the steps in those SSIS tutorial links are the same. I think the maximum 2 to 3 steps may differ.
- SSIS Tutorial on Connection Managers Introduction
- OLE DB Connection Manager
- ADO Connection Manager
- ADO.NET Connection Manager
- Cache Connection Manager
- EXCEL Connection Manager
- File Connection Manager
- FTP Connection Manager
- SMO Connection Manager
SSIS Tutorial on Sources
The next two days concentrate on learning SSIS tutorial on Source & Destinations. As I said before, if you know the connection managers, you are good with Destinations and the Sources.
The main motive of the SQL integration package is to transfer data from various sources to a destination. It means you need a Source to get the data from and a Destination to load into it. The following are the list of common sources used in the package development.
SSIS Tutorial on Destinations
SSIS tutorial on Transformations
SQL Integration Service is all about Sources, Transformations, and Destinations. You need Connection Managers to connect with sources and destinations. So, if you know the connection Manager, then you do not have to think about the Sources and Destinations.
Spend the next ten days is all about transformations. I don’t think; you need 10 days to complete the transformations. Because, in all the SSIS tutorial examples, we explained each transformation along with Source and Destination. However, you can skip those steps
SQL Integration Services Transformations modify or clean the data, performs data conversions, and perform data aggregations, etc. The following SSIS tutorial shows the list of available transformations. Please click on the link to see the definition and a practical example of each transformation.
- SSIS tutorial about the List of Transformations
- Audit Transformation
- Aggregate Transformation Basic Mode
- Aggregate Transformation Advanced Mode – Configure Multiple Outputs
- Cache Transformation
- Character Map Transformation
- Conditional Split Transformation
- Copy Column Transformation
- Data Conversion Transformation
- Derived Column Transformation
- Export Column Transformation
- Fuzzy Grouping
- Fuzzy Lookup
- Import Column
- Lookup Introduction
- Merge Transformation
- SSIS tutorial on Merge Join Transformation
- Multicast Transformation
- OLE DB Command Transformation
- Percentage Sampling
- Pivot Transformation in Integration Services 2008R2
- Pivot Transformation in Integration Services 2014
- Row Count
- Row Sampling
- Script Component As Source
- Use Script Component as Transformation
- Script Component as Destination
- SSIS tutorial on Slowly Changing Dimension
- Sort Transformation
- Term Lookup Transformation
- Term Extraction Introduction
- Union All
By the 15th day of this SSIS tutorial, you know the Connection Managers, Sources, Destinations, and Transformations. Learn SSIS containers and the Control Flow tasks from 15th to 20th.
SSIS Tutorial on Control Flow Tasks
Every SQL Integration Services package consists of a control flow tab. Within this control flow tab, you can optionally use the control flow tasks, one or more data flow tasks. Perhaps, you can use the combination of both the control flow task and data flow tasks.
SSIS Containers Tutorial
This section of SSIS tutorial covers the containers available in this ETL tool. The following containers provide the structure to the package or provide looping functionality.
- SSIS tutorial on For Loop Container
- SSIS tutorial about the ForEach Loop Container
SSIS Tutorial on Control Flow Tasks
This section of the SSIS tutorial explains everything about the control flow tasks.
- Bulk Insert Task
- Data Profiling Task
- Execute T-SQL Statement Task
- SSIS tutorial on Execute SQL Task
- Execute Package Task
- File System Task
- FTP Task
- Script Task
- Transfer SQL Server Objects Task
- Web Service Task
- XML Task – Validate XML File
SSIS Deployment Tutorial
Once we complete the building or developing the SQL integration package, the next step is deployment. Spend your last two days (21, 22) to learn SSIS catalog and deployment methods.
Deploying the SQL Integration Services project is where we should decide the package execution time, and the authorized user to perform the same. There are different ways that you can deploy your packages. It starts from using BIDS/SQL data tools, Import and Export Data wizard, and SQL Management Studio.
You can use either of these options to deploy packages to SQL Server. This SSIS tutorial section covers the most important topics, which are useful for the production environment.
- SSIS tutorial about creating Integration Service Catalog
- Deploy Projects using BIDS
- Deploy Project using SQLServer
- Use Deployment Wizard to Deploy Project
- Error Handling
- Event Handlers
- Package Configurations Introduction
- Package Protection Levels
SQL SSIS Tutorial on Import and Export Data Wizard
If you quickly want to move or load from source to destination, you can use the Import and Export wizard. You can perform the following import and export operations using a Wizard. This wizard might act as a starting point of SSIS Tutorial or package development.
- Export From SQL to Flat File using Import & Export Wizard
- Import from Flat File to SQL using Import Export Wizard
- Export Data in SQL to Excel using Wizard
- Import from Excel to SQL using Import Export Wizard
The following are the list of few SSIS interview questions that you might face apart from regular Transformation questions
- SSIS tutorial on Incremental Load
- Export From SQL Server to Excel File
- Export From SQL Server to Flat File
- Query builder
- How to remove Double Quotes in Excel Sheet
- How to remove Double Quotes in Flat or CSV File
- Text Qualifier Property
- Difference between Project Level and Package Level Connection managers
- Project Parameters Vs. Package Parameters
- Send Emails using Script Task