AugmntX

AugmntX is the world’s largest network of pre-vetted talent.

Contact Info

305, IRIS Corporate Centre,
Hiranandani Meadows, 400610.
hello@augmntx.com
+919820045154

Follow Us

Home / Developers / AXO22172
profile image
Pherwani R AXO22172 Active
Data Engineer in Indore
Over 5 years of experience in Python Data Engineering. Proficient in designing and developing data pipelines using a wide range of technologies including Python, Spark, Postgres, MySQL, ETL pipelines, Redshift, DataBricks, AWS. Skilled in using Python for data processing, statistical analysis, and forecasting. Experienced in developing new features and functionalities in Python and SQL according to business requirements. Designed and Developed an Automation Process for editing PDF text using Python and OpenCV. Hands-on experience working with Snowflake for running data pipelines handling huge volumes of data. Proficient in Agile, Scrum, and waterfall methodologies. Proactively suggested new designs for improving processes while handling clients. Familiarity with cloud technologies such as S3, ECR, ECS, CI/CD, AWS Redshift, RDS Postgres, ADF, and Snowflake.
Industries : FinTech, Content Publishing
Share
Hire Pherwani R
Download PDF
Availability
Full-time
Total experience
5 years
Technical skills
Python
5 Years
My SQL
5 Years
ETL
4 Years
DataBricks
3 Years
AWS
1 Years
ETL pipeline development, data extraction, testing, back-end logic, migration to AWS Redshift, Spark streaming configuration, microservices development. , DBT, Terraform, SQL,AWS,Snowflake
Projects
Upstream
Description
The Upstream Write project focuses on enhancing data flow efficiency by optimizing upstream data writing processes. This initiative aims to reduce latency, improve data accuracy, and ensure seamless integration with downstream systems. Key objectives include refining data pipelines, implementing real-time updates, and enhancing overall system performance to support robust data-driven decision-making.
Roles and Responsibilities
ETL Pipeline Development Designing and implementing ETL pipelines for efficient data extraction, transformation, and loading processes. Data Extraction Extracting data from various sources such as databases, APIs, and files in different formats. Testing: Conducting thorough testing of ETL processes to ensure data integrity, accuracy, and reliability. Back-end Logic: Developing and optimising back-end logic to support data processing and manipulation tasks. Migration to AWS Redshift Planning and executing the migration of data to AWS Redshift, ensuring smooth and efficient transfer. Spark Streaming Configuration: Configuring Spark streaming for real time data processing and analysis. Microservices Development Designing and implementing microservices architecture to support scalable and modular data processing workflows.
Technologies: ETL pipeline development, data extraction, testing, back-end logic, migration to AWS Redshift, Spark streaming configuration, microservices development.
Industry: FinTech
Content Elbert
Description
(Content Elbert)N23 is a web based application for automation of manual work process using machine learning models. In this project label-studio is integrated for labelling the data
Roles and Responsibilities
Migration to AWS Redshift Planning and executing the migration of data to AWS Redshift, ensuring smooth and efficient transfer. Spark Streaming Configuration: Configuring Spark streaming for real-time data processing and analysis. Microservices Development Designing and implementing microservices architecture to support scalable and modular data processing workflows.
Technologies: Python, DBT, Terraform, SQL,AWS,Snowflake
Industry: Content Publishing
Work history
Data Engineer • July-2019
Description: ● Over 5 years of experience in Python Data Engineering. ● Proficient in designing and developing data pipelines using a wide range of technologies including Python, Spark, Postgres, MySQL, ETL pipelines, Redshift, DataBricks, AWS. ● Skilled in using Python for data processing, statistical analysis, and forecasting. ● Experienced in developing new features and functionalities in Python and SQL according to business requirements. ● Designed and Developed an Automation Process for editing PDF text using Python and OpenCV. ● Hands-on experience working with Snowflake for running data pipelines handling huge volumes of data. ● Proficient in Agile, Scrum, and waterfall methodologies. ● Proactively suggested new designs for improving processes while handling clients. Familiarity with cloud technologies such as S3, ECR, ECS, CI/CD, AWS Redshift, RDS Postgres, ADF, and Snowflake.
Soft skills
Communication
Education
Bachelors degree in Electronics and Communication
RGPV
2015 to 2019
Language
English - Advanced