Roles and Responsibilities

Support and improve our data platform infrastructure and operational tools.
Design and deploy modern data analytics solutions using AWS.
Build and optimize CI/CD pipelines to improve the development and deployment processes of our Data Platform.
Maintain and enhance the development environment, including project setups, development tools, and scripting.
Collaborate with teams across engineering, testing, and security to ensure our systems are secure and efficient.

Qualifications

Experienced with AWS, with a strong understanding of cloud services and infrastructure.
Knowledgeable in Big Data concepts and experienced with AWS Glue, including setting up jobs, data cataloging, and managing crawlers.
Proficient in using and maintaining Apache Airflow for workflow management and Terraform for infrastructure automation.
Skilled in Python for scripting and automation tasks.
Independent and proactive in solving problems and troubleshooting issues.
Experience with AWS Lake Formation is a plus.
Familiarity with MSSQL, PostgreSQL, or similar relational databases is advantageous.
Understanding of Apache Kafka, including AWS MSK and Kafka Connect, is a plus.

Employment Type:

Full Time, Permanent

Skills:

continuous integration ci/cd docker cloud scripting security automation apache aws msk postgresql devops big data aws data lake deployment cd cloud services python airflow sql server aws glue amazon ec2 kafka streams infrastructure kafka terraform workflow management aws

PureSoftware Pvt Ltd

New Jobs

Data Devops Engineer