senior data engineer • September-2025 to September-2025
Description: ❖ Designed and implemented highly scalable real-time data pipelines using AWS Glue ETL, Step Functions, Lambda, and S3 for processing ad tech transaction data and performance metrics, ensuring seamless data movement across layers while maintaining 99.9% uptime. ❖ Engineered Spark optimizations within AWS Glue for real-time event processing that reduced CTR calculation processing time by 30% and limited worker usage, leading to improved efficiency and $50K annual cost savings for performance analytics workloads. ❖ Led cross-functional teams including data scientists and marketing analysts to deliver robust data solutions tailored to various business use cases, enhancing collaboration and project outcomes with focus on performance marketing optimization. ❖ Ensured data quality by implementing comprehensive validation checks and security protocols for real-time bidding data at each stage of the pipeline, guaranteeing accurate CTR, CPM, and revenue tracking in the business layer. ❖ Automated workflows with Step Functions and Lambda functions for ad performance monitoring, reducing manual intervention by 80% and enhancing reliability through robust error handling and real-time alerting systems.