Azure Databricks Lead Developer to drive large-scale data engineering initiatives and enable digital transformation across global clients.
As a Lead Developer, you will play a critical role in architecting, designing, and delivering high-performance data solutions using Azure ecosystem technologies. You will mentor teams, guide best practices, and ensure scalable, secure, and efficient data platforms.
🔹 Key Responsibilities:
- Lead design & development of Azure Databricks-based data platforms
- Build scalable pipelines using Spark, Kafka, Airflow, SQL, Python
- Architect data warehouse & data mart solutions (Data Vault, Dimensional Modeling)
- Implement CI/CD pipelines (GitHub Actions, Azure Pipelines, Jenkins, GitLab CI)
- Drive data privacy, governance, and compliance frameworks
- Enable real-time and batch data processing (streaming, micro-batches)
- Provide technical leadership, code reviews, and mentor engineering teams
- Collaborate with business stakeholders across retail/CPG domains
🔹 Required Skills:
- Strong experience in Azure + Databricks
- Expertise in distributed systems & big data architecture
- Hands-on with ETL, MDM, Data Quality, metadata management
- Experience with vector search / semantic retrieval (nice to have)
- Strong knowledge of data modeling (Relational + Dimensional)
- Prior experience in retail or CPG data environments
📍 Location: Plano, TX (Onsite/Hybrid – relocation required if outside area)
✈️ Travel: May require within the US
📌 Note: No visa sponsorship available
