Incremental load in SSIS with example

Incremental load in SSIS

 
Daily data — (Stores) –> Table
(Granularity data)
  1. Maintain history [SCD]
  2. Direct loading
  3. ETL loading (indirect load)
Eg: loading the specified days data from one table to another table.
Sol: Go to SSIS → variable → click add and create two variables
 
Name                   Scope                   Data type                                Value  
EDATE               Package              Data time 6/2/2011                 12:36 AM
SDATE               Package              Data 6/2/2011                          12:36 AM
 
1) OLEDB source → rt click → edit →
       
OLEDB connection manager: local host:: DB-MSBI
Access mode: SQL command.
SQL command text:
Select * from Emp-Daily where St-Dt between?
And?
Click parameters:
Parameter 0: USER:SDATE
Parameter 1: USER:EDATE
 
FREE Demo Class From Industry Experts - Enroll Now.!! MSBI training

2) OLEDB destination → EMP-HIST table.
3) SSIS menu → package configurations → check enable package configuration → click add → next
Configuration type: XML configuration file.
Configuration file name: Browse and specify file new name click nextà
Go to SDATE and EDATE and check the ‘value’ sections.
Next → finish → close
Open configuration file → change SDATE and EDATE and run the package.
MindMajix Youtube Channel

SSIS Import Export Wizard

It performs operations between database to database, database to file, file to file.
a) BIDS level:
 
Data source:
Server name: Local host
Database: DB-MSBI  → Click next →
 
 
[ ⁄ ] Copy tables or views
[ ⁄ ] Write a query to retrieve the data from data set
 
Now the system creates a package according to the settings given, execute the package and observe the result i.e., go to for DB new in databases and observe.
 
 
b) SSMS level:
 
                        
Explore MSBI Sample Resumes! Download & Edit, Get Noticed by Top Employers!Download Now!

List of Related Microsoft Certification Courses:

 SSRS Power BI
 SSAS SQL Server
 SCCM SQL Server DBA
 SharePoint BizTalk Server
 Team Foundation Server BizTalk Server Administrator

 

 

Course Schedule
NameDates
MSBI TrainingOct 15 to Oct 30View Details
MSBI TrainingOct 19 to Nov 03View Details
MSBI TrainingOct 22 to Nov 06View Details
MSBI TrainingOct 26 to Nov 10View Details
Last updated: 03 Apr 2023
About Author

Ravindra Savaram is a Technical Lead at Mindmajix.com. His passion lies in writing articles on the most popular IT platforms including Machine learning, DevOps, Data Science, Artificial Intelligence, RPA, Deep Learning, and so on. You can stay up to date on all these technologies by following him on LinkedIn and Twitter.

read less
  1. Share:
MSBI Articles