Experienced Big Data Engineer with a proven track record of designing and implementing robust data pipelines and analytics solutions. Passionate about turning raw data into valuable insights and driving data-driven decision-making.
DataFusion is a large-scale data processing platform that ingests, processes, and analyzes diverse data sources to provide actionable insights for business decision-making.
Roles and Responsibilities
Architected and developed data pipelines using Hadoop and Spark, integrated Kafka for real-time data streaming, and optimized SQL queries for performance. Collaborated with data scientists and analysts to define data requirements.
Technologies: Hadoop, Spark, Kafka, SQL
Industry: Analytics
E-Commerce Analytics
January-2018 to Present
Description
E-Commerce Analytics platform gathers and analyzes customer behavior data to improve user experience and drive sales growth on the e-commerce platform.
Roles and Responsibilities
Designed and maintained data processing workflows using Hive and Pig, implemented data warehousing solutions using HBase, and created interactive dashboards using Tableau to visualize insights for stakeholders.
Technologies: Hive, Pig, HBase, Tableau
Industry: Ecommerce
Work history
Big Data Engineer • July-2013 to Present
Description: As a Big Data Engineer at TechData Solutions, I am responsible for designing, developing, and maintaining scalable and efficient data pipelines for processing and analyzing large datasets.
Soft skills
problem-solving
teamwork
data analysis
Certifications
AWS Certified Big Data - Specialty by Amazon Web Services