Posts From September, 2013

-August 2017+
SMTWTFS
303112345
6789101112
13141516171819
20212223242526
272829303112
3456789
  • RSS
  • Add To My MSN
  • Add To Windows Live
  • Add To My Yahoo
  • Add To Google

Statistics

  • Entries (93)
  • Comments (0)

September 18 Mike Hotek: Build a Scalable Data Validation Framework 

Tuesday, September 10, 2013 10:16:00 PM Categories: Meeting

Wednesday, Sept 18th, 2013

6:30 PM Meet & Greet | 7 PM Presentation

 

Build a Scalable Data Validation Framework

Millions of ETL applications have been built using DTS, SSIS, Informatica, DataStage, and a host of other products.  The ETL may or may not get tested before it is deployed.  If it gets tested, we run them through some token “sample” data and call it good enough.  Inevitably almost every target database of these ETL applications comes crashing in on itself because no one was watching the single thing these systems are built for, DATA.  Processes blindly moving data around with no clue as to whether everything was actually moved or whether the data is even valid in the first place.  This session will walk you through building a framework using SSIS to perform internal and source to target data validation.

 

Site Map | Printable View | © 2008 - 2017 Fort Worth SQL Server Users Group | Powered by mojoPortal | HTML 5 | CSS | Original design by Andreas Viklund