Posts From September, 2013

September 18 Mike Hotek: Build a Scalable Data Validation Framework 

Tuesday, September 10, 2013 10:16:00 PM Categories: Meeting

Wednesday, Sept 18th, 2013

6:30 PM Meet & Greet | 7 PM Presentation

 

Build a Scalable Data Validation Framework

Millions of ETL applications have been built using DTS, SSIS, Informatica, DataStage, and a host of other products.  The ETL may or may not get tested before it is deployed.  If it gets tested, we run them through some token “sample” data and call it good enough.  Inevitably almost every target database of these ETL applications comes crashing in on itself because no one was watching the single thing these systems are built for, DATA.  Processes blindly moving data around with no clue as to whether everything was actually moved or whether the data is even valid in the first place.  This session will walk you through building a framework using SSIS to perform internal and source to target data validation.

 

Site Map | Printable View | © 2008 - 2017 Fort Worth SQL Server Users Group | Powered by mojoPortal | HTML 5 | CSS | Original design by Andreas Viklund