LTIMindtree is a global technology consulting and digital solutions company that enables enterprises across industries to reimagine business models, accelerate innovation, and maximize growth by harnessing digital technologies. As a digital transformation partner to more than 700 clients, LTIMindtree brings extensive domain and technology expertise to help drive superior competitive differentiation, customer experiences, and business outcomes in a converging world. Powered by 86,000+ talented and entrepreneurial professionals across more than 40 countries, LTIMindtree — a Larsen & Toubro Group company — solves the most complex business challenges and delivers transformation at scale. For more information, please visit https://www.ltimindtree.com/
Azure Databricks Lead
Location USA Eastern Time Zone 3 Days WFO NJ Location
- Technical Skills Primary
- 12 years of experience of working on Azure and Databricks Lakehouse implementation with grasp of following
- Translate business requirement into technical solution for data curation and consumptions
- Have experience in building Databricks Lakehouse from a modelling and transformation ELTperspective
- Experience in SQL programming Pyspark ADLS
- 2 or more years experience working as a Data EngineerExperience of developing in the Azure Modern Data Warehouse platform e g Azure Data Lake Azure Data Factory Azure Databricks Databricks Delta Lake etc
- 3 or more years experience in SQL
- Experience handling structured and unstructured datasets
- Good knowledge of DevOps tools and processes
- Expertise on Databricks delta lake implementation Databricks architecture and configuration
- Expertise in Azure Data Factory building pipelines and orchestration
- Should have prior experience doing SQL server migration to cloud
- Experience in effort estimation for the new projects
- Proven ability to drive complex design and development efforts in an agile environment
- Prior experience of migrating on premise SQL Server to Delta lake
- Automating data pipelines through a CI CD delivery methodology
- Expertise in Databricks Expert in ETL Pipelines
- Typical azure services current future usedADX ADF Databricks
- ADLS use in data ETL and storage
- In depth hands on implementation knowledge on Azure DatabricksDelta Lake Delta table Managing Delta Tables Databricks Cluster Configuration Cluster policies
- Expertise in Azure Data factory Data Flow Azure Data Bricks and Data Lake Storage
- Design and implement ETL components for multiple applications
- Good Understanding of data modelling for data lake
- Hands on experience in using secure file transfers tools like Kiteworks
- Oracle PL SQL knowledge a plus
Benefits and Perks:
- Comprehensive Medical Plan Covering Medical, Dental, Vision
- Short Term and Long-Term Disability Coverage
- 401(k) Plan with Company match
- Life Insurance
- Vacation Time, Sick Leave, Paid Holidays
- Paid Paternity and Maternity Leave
LTIMindtree is an equal opportunity employer that is committed to diversity in the workplace. Our employment decisions are made without regard to race, color, creed, religion, sex (including pregnancy, childbirth or related medical conditions), gender identity or expression, national origin, ancestry, age, family-care status, veteran status, marital status, civil union status, domestic partnership status, military service, handicap or disability or history of handicap or disability, genetic information, atypical hereditary cellular or blood trait, union affiliation, affectional or sexual orientation or preference, or any other characteristic protected by applicable federal, state, or local law, except where such considerations are bona fide occupational qualifications permitted by law.