Lead Developer - Databricks

Beghou Consulting; Hyderabad; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Beghou Consulting is hiring a Team Lead for Databricks Applications in Hyderabad to guide a small team building production-grade apps on the Databricks platform. You will drive architectural decisions, design robust data pipelines, and ensure secure, scalable solutions that align with business requirements.

You will mentor engineers, participate in Agile ceremonies, and collaborate with stakeholders to translate complex needs into technical deliverables, while focusing on performance and cost

Qualifications

• 8+ years of hands-on experience building production applications on Databricks or comparable cloud data platforms.
• 2+ years in a technical leadership role.
• Expert-level Python and SQL development skills.
• Strong experience with REST API and web application development.
• Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake.
• Experience with compute management and performance optimization at scale.
• Strong understanding of cloud security and identity management.
• Track record of turning prototypes into production-ready enterprise apps.

Responsibilities

• Architect and design production applications on the Databricks platform.
• Drive technical decisions on patterns, security, and performance.
• Build and optimise data pipelines using Databricks Workflows and Delta Lake.
• Establish coding standards, best practices, and code reviews.
• Configure Unity Catalog for data governance and access management.
• Oversee cloud security, service principals, and permissions strategy.
• Own application monitoring, performance tuning, and cost optimisation.
• Lead and mentor a team of 1-2 Databricks developers.
• Collaborate with stakeholders to translate requirements into solutions.
• Participate in Agile ceremonies and sprint planning/delivery.

Skills

Databricks

Python

SQL

REST API

Leadership

Communication

Education

Bachelor's or Master's in CS

Tools

Databricks Platform

Delta Lake

Unity Catalog

Job description

Beghou brings over three decades of experience helping life sciences companies optimize their commercialization through strategic insight, advanced analytics, and technology. From developing go-to-market strategies and building foundational data analytics infrastructures to leveraging artificial intelligence to improve customer insights and engagement, Beghou helps life sciences companies maximize performance across their portfolios. Beghou also deploys proprietary and third-party technology solutions to help companies forecast performance, design territories, manage customer data, organize, and report on medical and commercial data, and more. Headquartered in Evanston, Illinois, we have 10 global offices.

Our mission is to bring together analytical minds and innovative technology to help life sciences companies navigate the complexity of health care and improve patient outcomes.

About the Role

We are seeking an experienced Team Lead - Databricks Applications to lead a team of developers building production-grade applications on the Databricks platform. You will drive technical decisions, mentor engineers, and ensure delivery of enterprise-ready solutions.

What you will do

1. Architect and design production applications on the Databricks platform
2. Drive technical decisions on application patterns, security, and performance
3. Build and optimise data pipelines using Databricks Workflows and Delta Lake
4. Establish coding standards, best practices, and code review processes
5. Configure Unity Catalogue for data governance and access management
6. Oversee cloud security, service principals, and permissions strategy
7. Own application monitoring, performance tuning, and cost optimisation
8. Lead and mentor a team of 1-2 Databricks developers
9. Collaborate with stakeholders to translate requirements into technical solutions
10. Participate in Agile ceremonies and contribute to sprint planning and delivery

You'll need to have:

1. 8+ years of hands-on experience building production applications on Databricks or comparable cloud data platforms
2. 2+ years of experience in a technical leadership role
3. Expert-level Python and SQL development skills
4. Strong experience with REST API and web application development
5. Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake
6. Experience with compute management and performance optimization at scale
7. Strong understanding of cloud security, identity management, and service principals
8. Track record of turning prototypes into production-ready enterprise applications
9. Excellent communication and stakeholder management skills
10. Bachelor's or master's degree in computer science or related field

Preferred Qualifications

1. Experience with CI/CD pipelines and Git workflows
2. Familiarity with infrastructure as code (Terraform, ARM templates)
3. Automated testing strategies (unit, integration, end-to-end)
4. Frontend development experience with React
5. Databricks certifications (Data Engineer Associate, Platform Administrator)

At Beghou Consulting, you'll join a highly collaborative, values-driven team where technical excellence, analytical rigor, and personal growth converge. Whether you're passionate about AI innovation, building commercialization strategies, or shaping the next generation of data-first solutions in life sciences, this is a place to make an impact!