- Tools :
* Infrastructure & OS: Well versed with Red hat, Ubuntu, In House Data Center.
* Database Administration: Experience on CDP, Hadoop, MySQL & SQL.
* Security: Kerberos, LDAP, TLS, Ranger, SSSD.
* DevOps: Jenkins, GitLab CI/CD.
Responsibility:
- Troubleshoot and resolve complex deployment issues, performance bottlenecks, and system failures across the big data and CI/CD environments.
- Develop and maintain automation scripts using languages like Bash and Python to streamline system administration and deployment tasks.
- Collaborate with data engineers, data scientists, and development teams to optimize workflows and provide technical guidance.
- Document deployment processes, configurations, and troubleshooting steps.
- Troubleshoot and resolve complex deployment issues, performance bottlenecks, and system failures across the big data and CI/CD environments.
- Design, implement, and maintain CI/CD pipelines for automating software build, test, and deployment processes using tools like Jenkins, GitLab CI/CD, or other relevant technologies.
- Proficiency in Linux, with advanced knowledge of Red Hat Enterprise Linux (RHEL) versions.
- Experience in writing Linux shell scripts.
- Hands-on experience with big data technologies, particularly Apache Hadoop and Cloudera Data Platform (CDP).
- Experience with the deployment and administration of Dataiku, including knowledge of the Dataiku DSS and Project Deployer.
- Strong troubleshooting skills for resolving technical issues during deployments and production operations.
- Familiarity with cloud platforms (e.g., AWS) is a plus.
- Excellent problem-solving, communication, and collaboration skills.
- Bachelor’s degree in computer science, Information Technology, or a related field, or equivalent practical experience.
