Position: Cloud Engineer (Cloud Data Platform)
Skills: AWS and Azure Cloud Engineer / Administrator with knowledge/experience of solution architecting
Data Bricks: Experience on data bricks will be preferred.
Key Responsibilities:
- Platform Design & Implementation:
- Design, deploy, and manage Databricks workspaces on major cloud platforms (Azure, AWS).
- AWS cloud admin + Azure cloud admin
- Provision cloud services
- Architect and implement scalable, reliable, and secure cloud-based data solutions.
- Collaboration & Support:
- Work closely with cross-functional teams, including DevOps, Data Science, and Business Intelligence, to align platform capabilities with business goals.
- Provide expertise and guidance on Databricks best practices and data architecture.
- Security & Compliance:
- Implement robust security measures, including access controls, encryption, and data masking.
- Ensure compliance with organizational and regulatory requirements.
- Automation & Innovation:
- Develop Infrastructure as Code (IaC) scripts (Terraform, CloudFormation) for deploying Databricks and cloud resources.
- Drive automation initiatives for deployment, scaling, and monitoring of cloud-based data platforms.
Required Skills & Qualifications:
- Experience:
- Minimum of 10 years in cloud platform engineering, solution architect or similar roles.
- Technical Expertise:
- Proficiency in at least one cloud platform: AWS or Azure.
- Expertise with Infrastructure as Code (e.g., Terraform, CloudFormation).
- Other Skills:
- Strong understanding of CI/CD pipelines and DevOps practices.
- Knowledge of monitoring and logging tools for cloud-based platforms.
- Ability to troubleshoot and resolve complex technical issues.
Preferred Qualifications:
- Certifications in AWS, or Azure.
- Experience with containerization (Docker, Kubernetes).
- Familiarity with security frameworks like SOC2, GDPR, or HIPAA.
