Lead Developer - Databricks

Beghouconsulting; Hyderabad; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Beghou Consulting seeks an experienced Team Lead - Databricks Applications to guide a team building production-grade applications on the Databricks platform. You will drive technical decisions, mentor engineers, and ensure enterprise-ready solutions.

The role focuses on architecting and delivering Databricks-based data apps, building pipelines with Workflows and Delta Lake, and aligning with stakeholders to translate requirements into scalable tech.

Qualifications

• 8+ years hands-on experience building production applications on Databricks or comparable cloud data platforms.
• 2+ years of experience in a technical leadership role.
• Expert-level Python and SQL development skills.
• Strong experience with REST API and web application development.
• Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake.
• Experience with compute management and performance optimization at scale.
• Strong understanding of cloud security, identity management, and service principals.
• Track record of turning prototypes into production-ready enterprise applications.
• Excellent communication and stakeholder management skills.
• Bachelor's or master's degree in computer science or related field.

Responsibilities

• Architect and design production applications on the Databricks platform.
• Drive technical decisions on application patterns, security, and performance.
• Build and optimise data pipelines using Databricks Workflows and Delta Lake.
• Establish coding standards, best practices, and code review processes.
• Configure Unity Catalogue for data governance and access management.
• Oversee cloud security, service principals, and permissions strategy.
• Own application monitoring, performance tuning, and cost optimisation.
• Lead and mentor a team of 1-2 Databricks developers.
• Collaborate with stakeholders to translate requirements into technical solutions.
• Participate in Agile ceremonies and contribute to sprint planning and delivery.

Skills

Python

SQL

REST APIs

Web apps

Databricks

Delta Lake

Unity Catalog

Cloud security

Stakeholder mgmt

Communication

Education

Bachelor's or Master's in CS

Job description

Beghou brings over three decades of experience helping life sciences companies optimize their commercialization through strategic insight, advanced analytics, and technology. From developing go-to-market strategies and building foundational data analytics infrastructures to leveraging artificial intelligence to improve customer insights and engagement, Beghou helps life sciences companies maximize performance across their portfolios. Beghou also deploys proprietary and third-party technology solutions to help companies forecast performance, design territories, manage customer data, organize, and report on medical and commercial data, and more. Headquartered in Evanston, Illinois, we have 10 global offices.

Our mission is to bring together analytical minds and innovative technology to help life sciences companies navigate the complexity of health care and improve patient outcomes.

About the Role

We are seeking an experienced Team Lead - Databricks Applications to lead a team of developers building production-grade applications on the Databricks platform. You will drive technical decisions, mentor engineers, and ensure delivery of enterprise-ready solutions.

1. Architect and design production applications on the Databricks platform
2. Drive technical decisions on application patterns, security, and performance
3. Build and optimise data pipelines using Databricks Workflows and Delta Lake
4. Establish coding standards, best practices, and code review processes
5. Configure Unity Catalogue for data governance and access management
6. Oversee cloud security, service principals, and permissions strategy
7. Own application monitoring, performance tuning, and cost optimisation
8. Lead and mentor a team of 1-2 Databricks developers
9. Collaborate with stakeholders to translate requirements into technical solutions
10. Participate in Agile ceremonies and contribute to sprint planning and delivery

1. 8+ years of hands-on experience building production applications on Databricks or comparable cloud data platforms
2. 2+ years of experience in a technical leadership role
3. Expert-level Python and SQL development skills
4. Strong experience with REST API and web application development
5. Deep expertise in Databricks Apps, Workflows, Unity Catalog, and Delta Lake
6. Experience with compute management and performance optimization at scale
7. Strong understanding of cloud security, identity management, and service principals
8. Track record of turning prototypes into production-ready enterprise applications
9. Excellent communication and stakeholder management skills
10. Bachelor's or master's degree in computer science or related field

Preferred Qualifications

1. Experience with CI/CD pipelines and Git workflows
2. Familiarity with infrastructure as code (Terraform, ARM templates)
3. Automated testing strategies (unit, integration, end-to-end)
4. Frontend development experience with React
5. Databricks certifications (Data Engineer Associate, Platform Administrator)

At Beghou Consulting, you'll join a highly collaborative, values-driven team where technical excellence, analytical rigor, and personal growth converge. Whether you're passionate about AI innovation, building commercialization strategies, or shaping the next generation of data-first solutions in life sciences, this is a place to make an impact!