Job Description: DevOps / DevSecOps Engineer
A hands-on DevOps / DevSecOps Engineer to design, build, and operate secure, audit-ready CI/CD and release governance for an Azure-based data platform ecosystem covering Azure Databricks, Azure Data Factory (ADF), and Informatica IDMC. The role owns multi-environment deployment automation (Dev → UAT → Prod), embeds security controls, and ensures every release complies with customer IT security standards and audit expectations.
Experience:
• 6+ years overall experience in data platforms and cloud delivery, with at least 3+ years in Azure based data platforms and CI/CD implementation across Databricks, Azure Data Factory (ADF), and Informatica IDMC.
Key Responsibilities (R&R)
• Design, build, and operate Azure DevOps pipelines for Dev → UAT → Prod promotion with approval gates and segregation of duties.
• Implement environment aware deployments with parameterisation, secrets management, and rollback capability.
• Integrate Databricks Asset Bundles, notebooks, workflows, and jobs into standardized release pipelines.
• Enable CI/CD for ADF pipelines and IDMC mappings, ensuring dependency validation and controlled promotion.
• Implement rerun, replay, and recovery pipelines to support operational resilience.
• Embed DevSecOps controls including RBAC, least privilege access, MFA for privileged roles, and secure secret handling.
• Integrate platform alerts and deployment events with ServiceNow and enterprise monitoring tools.
• Ensure deployments comply with customers IT Security standards and audit expectations.
• Act as DevOps SPOC across data engineering, governance, security, and platform teams.
Mandatory Skills (Must Have)
• CI/CD for Azure Databricks (Notebooks, Jobs, Workflows, Asset Bundles).
• Azure Data Factory (ADF) CI/CD and environment promotion.
• Informatica IDMC deployment and promotion concepts.
• Azure DevOps pipelines and Git branching strategies.
• Secrets management using Azure Key Vault.
• Entra ID / Azure AD (RBAC, SSO, SCIM concepts).
• Strong DevSecOps fundamentals in regulated enterprise environments.
• Experience working with multi environment (Dev/UAT/Prod) data platforms.
Good to Have Skills
• Unity Catalog awareness (deployment impact, permissions, lineage dependencies).
• ServiceNow integration for alerts and change notifications.
• Exposure to Azure Sentinel / security logging integration.
• Experience supporting data platform reruns, reconciliation, and DLP operations.
• Understanding of metadata driven ingestion and orchestration frameworks.
• Experience in large enterprise / public sector / regulated environments.
Behavioural & Delivery Expectations
• Strong ownership mindset with accountability for CI/CD and release governance.
• Ability to operate under tight go-live timelines while maintaining audit discipline.
• Strong collaboration skills across engineering, platform, and security teams.
