Results-driven Data Engineer with 4+ years of experience in designing, building, and optimizing Azure based data pipelines. Expertise in Azure Data Factory (ADF),Azure Databricks,Azure Synapse Analytics, and ETL/ELT workflows for processing structured and unstructured data. Strong proficiency in SQL, Python, and Scala, with hands-on experience in big data frameworks, data warehousing, and real-time data streaming solutions. Adept at data governance, security, and compliance, ensuring scalable and high-performance data solutions. Experienced in CI/CD pipelines and DevOps practices for automation and deployment.
Built enterprise-grade ETL pipelines using ADF and Databricks, optimizing data transformation and storage. Integrated Azure Synapse Analytics to support high-performance data processing and reporting. Designed data models and schema architectures for structured and unstructured data storage.
Roles and Responsibilities
Built enterprise-grade ETL pipelines using ADF and Databricks, optimizing data transformation and storage. Integrated Azure Synapse Analytics to support high-performance data processing and reporting.
Technologies: Azure Data Factory, Databricks
Industry: Social Network
Data Warehousing & Analytics
Description
Designed and optimized data warehouse solutions, integrating Azure SQL, Synapse Analytics, and Snowflake. Developed SQL-based transformations, ensuring fast and efficient query execution. Built CI/CD pipelines using Azure DevOps, enabling automated testing and deployment.
Roles and Responsibilities
Designed and optimized data warehouse solutions, integrating Azure SQL, Synapse Analytics, and Snowflake. Developed SQL-based transformations, ensuring fast and efficient query execution.