AugmntX

AugmntX is the world’s largest network of pre-vetted talent.

Contact Info

305, IRIS Corporate Centre,
Hiranandani Meadows, 400610.
hello@augmntx.com
+919820045154

Follow Us

Home / Developers / AXF19966
profile image
Mahajan P AXF19966 Active
Data Engineer in Hyderabad
Database Engineer with experience in Designing, Developing, Testing and maintaining scalable data platforms, ETL pipelines on Cloud ( AWS). Possess strong technical acumen, leadership capabilities, and effective team communication skills with a total 5+ years of experience. Skilled in Python, SQL, and AWS services ( (S3, ECS, Cloudwatch, Glue, Redshift, IAM, EMR, Athena)
Industries : Finance, Banking
Share
Hire Mahajan P
Download PDF
Availability
Full-time
Total experience
5 years
Technical skills
Python
4 Years & 4 Months
AWS
4 Years & 5 Months
SQL
4 Years
Spark
4 Years
Hadoop
4 Years
ETL
4 Years & 6 Months
Airflow,
Projects
Airflow ETL pipeline
February-2023 to May-2024
Description
Developed an ETL pipeline from scratch for data ingestion into AWS Redshift from client APIs, encompassing synchronous API calling, preprocessing data through Glue Jobs, handling large datasets, managing data, implementing backups, and orchestrating Apace Airflow DAGs Python | Apache Airflow | AWS(S3, ECS, Cloudwatch, Glue, Redshift, IAM, EMR, Athena) | SQL | JQ | Docker
Roles and Responsibilities
Develop ETL from start, client APIs, encompassing synchronous API calling, preprocessing data through Glue Jobs, handling large datasets, managing data, implementing backups, and orchestrating Apace Airflow DAGs
Technologies: AWS, Airflow, python, SQL
Industry: Finance
AWS Data Pipeline
February-2019 to May-2021
Description
Build AWS based data pipeline for real time data, process and transform the data for analytics
Roles and Responsibilities
Built AWS based data pipeline for a highly scalable data platform by utilizing microservice architecture for big data processing running on fully on various AWS Services. The platform was a highly asynchronous and event-driven system with high throughput. It was 80% more cost-efficient and 75% faster than the legacy SQL DB platform. Worked On near real-time Analytics, Onboarded and Migrated around 15-17 enterprise clients to the new serverless SAAS platform. AWS(S3, ECS, Cloudwatch, Glue, Redshift, IAM, EMR, Athena)| Python | SQL | Big Data |ETL | Oracle Database
Technologies: AWS, Python,
Industry: Banking
Work history
Data Engineer • February-2023 to May-2024
Description: Developed an ETL pipeline from scratch for data ingestion into AWS Redshift from client APIs, encompassing synchronous API calling, preprocessing data through Glue Jobs, handling large datasets, managing data, implementing backups, and orchestrating Apace Airflow DAGs Python | Apache Airflow | AWS(S3, ECS, Cloudwatch, Glue, Redshift, IAM, EMR, Athena) | SQL | JQ | Docker
Education
Bachelors degree in Computer Sceince
NITJ
2014 to 2018
Language
English - Native