When you are tasked to build a data warehouse, you will come across the incremental loading pattern. With incremental loading you want to update (or delete) existing rows and insert new rows into your data warehouse dimensions or fact tables. Andy Leonard has done a great job posting some patterns you could follow here.
- Follow Big Data and Analytics on WordPress.com
My latest entries
TagsActive Operations Best Practices Big Data BIML C# catalog.executions catalog.stop_operation Clustered Columnstore Index Compression Data loading Data mapping Data modelling Data Warehouse DB Recovery Model ETL Execution_ID Fact Table Indexes Integration Services Catalogs Lookup Maxdop Minimally logged operations NoSQL Partition Function Partition Switch Partition Switching Partition Switch Out Performance POC Lessons Rebuild Index Rebuild Index Big Table Rebuild Partition Service Pack SQL Joins SQL Log SQL Parameters SQL Server SQL Server 2016 CTP SQL Server environment SQL Server Management Studio SQL Service SSIS SSIS.Catalog SSIS Package Paramater SSIS Project Paramater SSMS Custom Color SSMS Customisation SSMS Project sysobjects Trace Flag 610 TSQL Windows Server