Azure Data Engineer

Hitachi Systems India Pvt Ltd • Full-time • Pune, Maharashtra, India • 1d ago

Experience level : 5+ Yeras

Requirements:

5+ years of full-time experience as an Azure Data Engineer, with extensive knowledge of ADF, ADLS, Databricks, and Synapse
Able to quickly write SQL for database querying and DAX for creating custom calculations
Able to develop Extraction pipelines to load the data using ADF or comparable technologies and Transformation and Load pipelines using ADF and Databricks
Able to design a storage solution on ADLS utilizing Parquet and Delta table formats
Able to design star-schema data models in ADLS, Azure SQL, and Synapse databases
Understand data modeling concepts and be able to create effective data models to support reporting needs
Perform data ETL processes to ensure that data sets are clean, accurate, and ready for analysis
Improve the scalability, efficiency, and cost-effectiveness of data pipelines
Monitor and resolve data pipeline problems to ensure consistency and availability of the data
Unwavering ability to quickly propose solutions by recalling the latest best practices learned from MVP & Product Team articles, MSFT documentation, whitepapers, and community publications
Work closely with stakeholders to understand requirements, deliver solutions that meet those needs, and bridge the gap between technical and non-technical sides
Excellent communication, presentation, influencing, and reasoning skills

Primary Skills:

Data Engineering: Extensive knowledge in Azure SQL, T-SQL, Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse/Data Warehouse, SSIS, Key Vaults, Azure Functions, Azure Logic Apps, etc
Data Modeling: Design data models for ETL and reporting needs based on the requirements gathered and data discovery conducted in the source systems
Experience working in Agile environments with continuous integration and continuous deployment and application lifecycle management - experience in DevOps CI/CD repos and pipelines, and GitHub or Bitbucket
Secondary Skills:
Experience in detailed design aspects in Azure, including design patterns and principles
Experience with performance tuning of data processing pipelines and cloud-based applications
Experience in setting up and administering DevOps and GitHub or other automation tools like Jenkins/Puppet/ Ansible/Terraform
Possess good knowledge of M, Vertipaq Analyzer, and Power BI Service architecture design and administration
Certifications in Microsoft Azure, Data Analytics.

Related Jobs

Sr.Cloud Engineer-Azure DevOps/Infra

Crescendo Global • Full-time • Pune, Maharashtra, India • 1d ago

Other

1d ago

Azure DevOps Engineer

Emerson • Full-time • Pune, Maharashtra, India • 3d ago

Other

3d ago

DevOps/Cloud Engineer

gft technologies • Full-time • Pune, Maharashtra, India • 1w ago

Cloud Engineer

1w ago

Lead DevOps

ZK Technologies • Full-time • Pune, IN • 8h ago

Devops Lead

8h ago

DevOps Engineer

Accenture • Pune, India • 13h ago

Senior DevOps Engineer

13h ago

Engineer - I DevOps

Accelya • Full-time • Pune/Pimpri-Chinchwad Area, IN • 1d ago

DevOps Engineer (Entry Level)

1d ago

SAP Security GRC DevOps Lead

Johnson Controls • Contract • Pune/Pimpri-Chinchwad Area, IN • 2d ago

Devops Lead

2d ago

DevOps Engineer

VOIS • Full-time • Pune, IN • 2d ago

Senior DevOps Engineer

2d ago

Azure DevOps and Release Manager

Saisystems Digital • Full-time • Pune, IN • 2d ago

Devops Lead

2d ago

Cloud Platform Engineer

Accenture • Pune, India • 2d ago

Cloud Engineer

2d ago