Experienced Data Engineer skilled in designing, implementing, and maintaining scalable data pipelines. Passionate about transforming raw data into meaningful insights to drive informed business decisions.
Developed a data pipeline to analyze customer behavior on an e-commerce platform, enabling targeted marketing campaigns and improving customer engagement.
Roles and Responsibilities
Designed ETL processes using Apache Spark. Implemented data transformations and aggregations. Created visualizations for business insights.
Technologies: Apache Spark, SQL, Python
Industry: Ecommerce
Real-time Sensor Data Processing
May-2019 to December-2021
Description
Built a real-time data processing pipeline to handle sensor data from IoT devices, enabling instant monitoring and alerting for industrial equipment.
Roles and Responsibilities
Designed and optimized data ingestion using Kafka. Implemented stream processing with Apache Flink. Stored and queried data using Hadoop ecosystem.
Technologies: Kafka, Apache Flink, Hadoop
Industry: Industrial IoT
Work history
Data Engineer • April-2017 to Present
Description: Designing and developing data pipelines, collaborating with cross-functional teams, and optimizing data storage and processing.
Soft skills
problem-solving
teamwork
Certifications
Certified Apache Spark Developer by Databricks
2019
Google Cloud Professional Data Engineer by Google Cloud