Azure DevOps engineer (Databricks)

Largeton Group • Contract • New Jersey, United States, US • 5m ago

Job Summary

Azure DevOps Engineer - Databricks - 12+ Years

Design, build, and maintain CI/CD pipelines for Azure Data Factory and Databricks notebooks.
Automate unit, integration, and QA testing workflows in Databricks.
Implement and manage CI/CD pipelines for schema updates, leveraging strong data architecture skills.
Develop and maintain Azure DevOps Pipelines using YAML builds and release workflows.
Write and maintain scripts using Python, PowerShell, and Terraform for automation and infrastructure management.
Utilize Azure services, including ADF, Databricks, DABs, ADLS Gen2, Key Vault, and Azure DevOps (ADO).
Apply infrastructure-as-code best practices to manage and provision cloud resources.
Collaborate with Data Engineers and Platform teams to support development, staging, and production environments.
Monitor, troubleshoot, and resolve pipeline failures and deployment inconsistencies.
Ensure the reliability and scalability of data pipelines and deployment processes.