JOB DESCRIPTION:
We are seeking a highly skilled and technically proficient Senior Data Engineer with deep expertise in AWS services and data engineering frameworks. The ideal candidate will play a pivotal role in designing, building, and optimizing scalable data pipelines and cloud-native solutions. This role demands a strong understanding of cloud architecture, data modeling, and excellent communication skills to collaborate across cross-functional teams.
Key Responsibilities:
- Architect and implement robust data pipelines using AWS services such as Glue, EC2, ECS, Lambda, Step Functions, IAM, Athena, Presto, S3, and Redshift
- Collaborate with stakeholders to define source-to-target mappings and contribute to the development of target data models
- Enable scalable data engineering solutions using Python, Apache Spark, and other modern frameworks
- Optimize data workflows and ensure high performance, reliability, and security across cloud environments
- Provide technical leadership and mentorship to junior engineers and data analysts
- Communicate effectively with technical and non-technical stakeholders to translate business requirements into technical solutions
- Work with tools like HUE and Dremino (preferred) to enhance data accessibility and usability
Required Skills & Qualifications:
- Proven hands-on experience with AWS data services and cloud infrastructure
- Strong programming skills in Python and Spark for data processing and transformation
- Experience in designing and implementing ETL/ELT pipelines and data lake architectures
- Familiarity with data modeling concepts and ability to contribute to schema design
- Knowledge of Dremino or similar query engines is a plus
- Excellent problem-solving and analytical skills
- Strong communication and collaboration abilities
Preferred Qualifications:
- AWS certifications (e.g., AWS Certified Data Analytics, Solutions Architect)
- Experience with CI/CD pipelines and DevOps practices in cloud environments
