Role Overview
We are seeking an experienced DevOps Engineer to support the DataSphere platform, a comprehensive data lakehouse solution hosted on the AWS Government Commercial Cloud (GCC) environment.
The successful candidate will be responsible for building and maintaining robust CI/CD pipelines, implementing Infrastructure-as-Code, supporting platform operations, and ensuring compliance with stringent government security, governance, and data protection requirements.
Key Responsibilities
CI/CD & DevOps
- Develop, maintain, and optimise CI/CD pipelines using the SHIP-HATS tools ecosystem.
- Configure and manage GitLab for source control and automated deployment workflows.
- Implement code quality gates using SonarQube.
- Manage security and vulnerability scanning using Fortify on Demand (FOD).
- Manage dependency scanning and governance using Nexus IQ.
- Coordinate with CloudSCAPE for security compliance scanning and remediation.
- Implement Infrastructure-as-Code using Terraform and other approved tools.
- Support containerisation and orchestration technologies across the platform.
Security & Compliance
- Implement and maintain Automated Baseline Log Review (ABLR) systems.
- Manage Central Accounts Management (CAM) integration for secure user access control.
- Coordinate and remediate Vulnerability Assessment and Penetration Testing (VAPT) findings.
- Ensure compliance with Personal Data Protection Impact Assessment (PDPIA) requirements.
- Implement and maintain Vulnerability Management System (VMS) processes.
- Support government security clearance, data classification, and sensitive data handling requirements.
- Implement encryption and secure key management practices.
Platform Operations
- Monitor platform performance, availability, and reliability and implement optimisation measures.
- Manage secrets and encryption key rotation to ensure data protection.
- Configure email notifications for data processing status, failures, and error alerts.
- Implement and maintain data retention policies.
- Support SaaS whitelisting processes and required approvals.
- Coordinate System Security Acceptance Testing (SSAT) activities.
- Support troubleshooting, operational maintenance, and platform enhancements.
Collaboration & Support
- Work closely with Data Engineers, Data Analysts, security teams, and technical stakeholders.
- Provide DevOps support across multiple datamarts.
- Provide technical guidance for Raw-to-Tech and Tech-to-Business data pipelines.
- Collaborate with government divisions and stakeholders to ensure successful delivery.
- Support training environment setup for user onboarding and technical skill development.
- Maintain technical documentation, operational procedures, and knowledge-sharing materials.
Required Skills & Qualifications
Technical Skills
- Minimum 3 years of hands-on DevOps Engineering experience.
- Strong experience with AWS
- Proficiency in Terraform and Infrastructure-as-Code practices.
- Strong experience developing and managing GitLab CI/CD pipelines.
- Hands-on knowledge of SonarQube, Fortify on Demand (FOD), and Nexus IQ.
- Experience with SHIP-HATS or similar government-approved DevOps toolchains is highly desirable.
- Experience with containerisation and orchestration technologies such as Docker and Kubernetes.
- Strong scripting skills in Python, Bash, or PowerShell.
- Understanding of CI/CD security, automated testing, deployment, and release management.
Security & Compliance
- Experience working in government environments, particularly GCC environments.
- Knowledge of government security frameworks, compliance requirements, and security clearance processes.
- Understanding of Sensitive High data classification and handling procedures.
- Strong knowledge of encryption mechanisms, secrets management, and key rotation.
- Experience with vulnerability assessment, remediation, and security scanning.
- Familiarity with security monitoring, incident response, and security operations.
- Understanding of VAPT, PDPIA, SSAT, ABLR, and VMS processes is highly desirable.
Preferred Certification
- AWS Certified DevOps Engineer or equivalent AWS certification.
Experience & Methodology
- Minimum 3 years of DevOps engineering experience.
- Prior experience supporting government or highly regulated environments.
- Experience working in Agile development and delivery environments.
- Experience supporting cloud-based data platforms or data lakehouse environments is an advantage.
Personal Attributes
- Strong communication and collaboration skills.
- High attention to detail and commitment to security best practices.
- Strong documentation and knowledge-sharing capabilities.
- Proactive approach to monitoring, troubleshooting, and platform maintenance.
- Ability to work effectively with technical teams, security teams, and government stakeholders.
- Strong ownership and ability to operate in a highly governed environment.
