Role: Senior Infrastructure Engineer – Terraform & Databricks
Location: San Francisco, CA
Mode of Hire: Full Time
Skills Required
- 7+ years in infrastructure, platform or DevOps engineering with atleast 3 years of hands-on Terraform in production.Terragrunt experience is strongly preferred.
- 2+ years running Databricks on AWS, including workspace provisioning, Unity Catalog, cluster policies and the Databricks Terraform provider.
- Deep AWS knowledge; VPC networking, PrivateLink, IAM, KMS, S3, Secrets Manager and CloudWatch.
- Experience with CI/CD for Infrastructure as code (GitHub Actions, Jenkins or similar) and with GitOps workflows.
- Strong grasp of cloud security and compliance: encryption, network isolation, least privilege and audit logging. Experience in regulated environments such as financial services is a plus.
- Scripting skills in Python and/or Bash. Go is a plus for Terratest.
- Comfortable with Git, Code reviews and writing clear technical documentation.
Nice to have
- Databricks certifications (Data Engineer Associate/Professional or Platform Administrator), or HashiCorp Terraform Associate.
- Experience with Dela Live Tables, Vector Search, Model Serving or MLops Infrastructure.
- Familiarilty with Dagster, Dbt, Spark and Delta Lake.
- Experience with Wiz, Checkov, tfsec or similar policy-as-code and CSPM tools.
- Background in FinOps or cloud cost optimization.
- Experience with SOC 2 or similar compliance frameworks