Job Title: Cloud Architect with DevOps
Location: Noida (Hybrid)
Job Type: Full-Time | Permanent
Experience: 7+ years
Job Summary:
We are seeking an experienced Cloud Architect with strong DevOps expertise to lead and support our cloud transformation journey. The ideal candidate will be responsible for designing scalable and secure cloud architectures, driving cloud migration from traditional ETL tools (e.g., IBM DataStage) to modern cloud-native solutions, and enabling DevOps automation and best practices. The candidate must also have strong hands-on experience with Spark and Snowflake, along with a strong background in optimizing cloud performance and addressing cloud security vulnerabilities.
Key Responsibilities:
- Design and implement scalable, secure, and high-performance cloud architectures in AWS, Azure, or GCP.
- Lead the cloud migration of ETL workloads from IBM DataStage to cloud-native or Spark-based pipelines.
- Architect and maintain Snowflake data warehouse solutions, ensuring high performance and cost optimization.
- Implement DevOps best practices, including CI/CD pipelines, infrastructure as code (IaC), monitoring, and logging.
- Drive automation and operational efficiency across build, deployment, and environment provisioning processes.
- Proactively identify and remediate cloud security vulnerabilities, ensuring compliance with industry best practices.
- Collaborate with cross-functional teams including data engineers, application developers, and cybersecurity teams.
- Provide architectural guidance on Spark-based big data processing pipelines in cloud environments.
- Support troubleshooting, performance tuning, and optimization across platforms and tools.
Required Qualifications:
- 7+ years of experience in cloud architecture, DevOps engineering, and data platform modernization.
- Strong expertise in AWS, Azure, or GCP cloud platforms.
- Proficient in Apache Spark for large-scale data processing.
- Hands-on experience with Snowflake architecture, performance tuning, and data governance.
- Deep knowledge of DevOps tools: Terraform, Jenkins, Git, Docker, Kubernetes, Ansible, etc.
- Experience with cloud migration, especially from legacy ETL tools like IBM DataStage.
- Strong scripting and automation skills in Python, Bash, or PowerShell.
- Good understanding of networking, cloud security, IAM, VPCs, and compliance standards.
- Experience implementing CI/CD pipelines, observability, and incident response in cloud environments.
Preferred Qualifications:
- Certification in one or more cloud platforms (e.g., AWS Solutions Architect, Azure Architect).
- Experience with data lake and lakehouse architectures.
- Familiarity with modern data orchestration tools like Airflow, DBT, or Glue.
- Working knowledge of Agile methodologies and DevOps culture.
- Familiarity with cost management and optimization in cloud deployments.