We are seeking a Data Engineer to design, optimize, and enhance enterprise-grade Data Analytics solutions on Microsoft Azure. The ideal candidate will have deep expertise in Azure data services including Azure Databricks, Azure Data Factory (ADF), and Azure Data Lake Storage Gen2 (ADLS Gen2), along with strong CI/CD implementation experience.
This role requires hands-on technical leadership, architecture ownership, and the ability to mentor engineering teams while driving best practices in data engineering and DevOps.
Roles & Responsibility
- Lead the architecture, design, and optimization of scalable data platforms on Azure
- Build and maintain robust data pipelines using Azure Data Factory (ADF)
- Develop and optimize data transformations using Azure Databricks (PySpark/Scala/SQL)
- Implement data lake architecture using Azure Data Lake Storage Gen2 (ADLS Gen2)
- Design medallion architecture (Bronze/Silver/Gold layers) and data governance best practices
- Ensure performance tuning, cost optimization, and security compliance of Azure resources
- Implement CI/CD pipelines for data engineering workflows using Azure DevOps or similar tools
