Experience level : 5+ Yeras

Requirements:

5+ years of full-time experience as an Azure Data Engineer, with extensive knowledge of ADF, ADLS, Databricks, and Synapse
Able to quickly write SQL for database querying and DAX for creating custom calculations
Able to develop Extraction pipelines to load the data using ADF or comparable technologies and Transformation and Load pipelines using ADF and Databricks
Able to design a storage solution on ADLS utilizing Parquet and Delta table formats
Able to design star-schema data models in ADLS, Azure SQL, and Synapse databases
Understand data modeling concepts and be able to create effective data models to support reporting needs
Perform data ETL processes to ensure that data sets are clean, accurate, and ready for analysis
Improve the scalability, efficiency, and cost-effectiveness of data pipelines
Monitor and resolve data pipeline problems to ensure consistency and availability of the data
Unwavering ability to quickly propose solutions by recalling the latest best practices learned from MVP & Product Team articles, MSFT documentation, whitepapers, and community publications
Work closely with stakeholders to understand requirements, deliver solutions that meet those needs, and bridge the gap between technical and non-technical sides
Excellent communication, presentation, influencing, and reasoning skills

Primary Skills:

Data Engineering: Extensive knowledge in Azure SQL, T-SQL, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse/Data Warehouse, SSIS, Key Vaults, Azure Functions, Azure Logic Apps, etc
Data Modeling: Design data models for ETL and reporting needs based on the requirements gathered and data discovery conducted in the source systems
Experience working in Agile environments with continuous integration and continuous deployment and application lifecycle management - experience in DevOps CI/CD repos and pipelines, and GitHub or Bitbucket
Secondary Skills:
Experience in detailed design aspects in Azure, including design patterns and principles
Experience with performance tuning of data processing pipelines and cloud-based applications
Experience in setting up and administering DevOps and GitHub or other automation tools like Jenkins/Puppet/ Ansible/Terraform
Possess good knowledge of M, Vertipaq Analyzer, and Power BI Service architecture design and administration
Certifications in Microsoft Azure, Data Analytics.

Hitachi Systems India Pvt Ltd

New Jobs