Job Description:
We are looking for a DevOps Engineer with experience in CI/CD implementation for various Data Engineering Pipeline use cases. Candidate should have below:
- Hands-on experience with GitHub Actions, strong proficiency in Shell/Bash/Python scripting to enable complex Data engineering CI/CD pipeline , error handling, and system monitoring.
- Hands-on experience in creating CI/CD pipeline YAML files using GitHub Actions to automate build, test, and deployment processes for Data Engineering pipelines.
- Hands-on experience in implementing branching strategies such as multi environment deployment from single repository, feature branching, or release branching in the CI/CD process to ensure proper version control and smooth deployments.
- Hands-on experience with Terraform(IaC) for GCP Infra provisioning Automation
- Good to have hands-on experience with GCP Services such as Network, Dataproc, IAM, Cloudfunction, Composer, Bigquery, Dataflow, Pubsub, Dataplex, Spanner, AlloyDB, gcloud CLI etc.
