Module Lead • March-2014
Description: • Migrating 460 tables from oracle, MySQL and Netezza databases using Sqoop to Hadoop • Developed utility to pull multiple tables from different environments by taking config parameters • Creating layered architecture to bring data from incoming, staging, work and then to gold layer. • Bring history then performing data cleansing activities like removing duplicates, removing extra characters, with strategy of loading full-load and incremental