About Position:
We are seeking a skilled DevOps Engineer to design, implement, and manage CI/CD pipelines and infrastructure automation for migration projects from Teradata to Databricks on AWS. The role involves ensuring smooth deployment, scalability, and operational efficiency of data pipelines and applications in a cloud environment.
- Role: Devops Engineer
- Location: Bangalore
- Experience: 8+years
- Job Type: Full Time Employment
What You'll Do:
- Design and implement CI/CD pipelines for Databricks jobs and ETL workflows.
- Automate infrastructure provisioning on AWS using tools like Terraform or CloudFormation.
- Manage Databricks workspace configuration, cluster setup, and job orchestration.
- Integrate source control (Git) with Databricks and ensure versioning of notebooks and scripts.
- Implement monitoring and alerting for Databricks jobs and AWS resources using CloudWatch and other tools.
- Optimize cost and performance of AWS resources and Databricks clusters.
- Collaborate with data engineering and testing teams to ensure smooth deployments.
- Ensure compliance with security best practices (IAM roles, encryption, access control).
- Troubleshoot deployment issues and provide operational support for production environments.
Expertise You'll Bring:
- Strong experience in DevOps practices for data platforms.
- Hands-on experience with AWS services (EC2, S3, IAM, Glue, Lambda, CloudWatch).
- Proficiency in Databricks administration and job orchestration.
- Expertise in CI/CD tools (Azure DevOps, Jenkins, GitHub Actions, or similar).
- Knowledge of Infrastructure as Code tools (Terraform, AWS CloudFormation).
- Familiarity with Python, Shell scripting, and Spark for automation.
- Experience with containerization (Docker) and orchestration (Kubernetes) is a plus.
- Strong understanding of security and compliance in cloud environments.
Benefits:
- Competitive salary and benefits package
- Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
- Opportunity to work with cutting-edge technologies
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
- Annual health check-ups
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents
Values-Driven, People-Centric & Inclusive Work Environment:
Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.
- We support hybrid work and flexible hours to fit diverse lifestyles.
- Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
- If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment
Let's unleash your full potential at Persistent - persistent.com/careers
"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."
