Senior Data Engineer • September-2022 to April-2025
Description: Led and managed automation initiatives for data governance projects, including data quality checks, metadata management, and data lineage tracking. • Gathered and cleaned data from CAFM/CMMS databases and other sources. • Designed, built, and maintained data pipelines in the Azure environment using tools like Azure Data Factory (ADF), Databricks, GCP, ascend and PySpark. • Proficient in SQL and Python, with strong knowledge of big data tools and statistical methodologies applied to pharmaceutical research. • Developed and maintained automation dashboards and reports to monitor data quality and governance processes. • Contributed to developing a comprehensive BPMN workflow engine using the Camunda platform and created/modified BPMN workflows in Collibra. • Played a pivotal role in data migration and conversion, ensuring data integrity and security, and developed APIs for data migration and customized Collibra data using Spring Boot.