Databricks SQL Engineer (Pharma/Life Sciences background)

Talpro; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Talpro India Private Limited is seeking an experienced Databricks SQL Engineer with a Pharma or Life Sciences background to join our offshore Data Engineering team. The role focuses on building efficient, scalable SQL-based data models and pipelines using Databricks SQL, Spark SQL, and Delta Lake.

You will design and optimize queries, implement Delta Lake and Unity Catalog for governed data assets, ensure data quality, and collaborate with stakeholders to enable analytics across pharma

Qualifications

• 5+ years of experience in Pharma or Life Sciences.
• Shift timing: Day shift IST, starting at 12pm.
• Work mode: Hybrid (3 days in office weekly).
• Mandatory skills: Databricks, SQL, PySpark.

Responsibilities

• Design and optimize SQL queries and data models in Databricks for large datasets.
• Develop and maintain robust ETL/ELT pipelines using Databricks workflows.
• Implement Delta Lake and Unity Catalog for governed data assets.
• Ensure data quality with validation, tests, and monitoring.
• Optimize performance and cost in the lakehouse environment.
• Collaborate with stakeholders to support analytics needs.
• Deploy notebooks and SQL workflows with CI/CD.
• Document pipelines and data models for self-service.

Tools

Databricks

SQL

PySpark

Job description

TALPRO INDIA PRIVATE LIMITED | Full time

Talpro is leading the way in transforming the talent acquisition landscape. We deliver innovative, sustainable, and cost-effective recruitment solutions tailored to today’s business needs. Our mission is to offer comprehensive hiring strategies that address immediate recruitment demands while laying the groundwork for long-term success.

Job Description

Job Description

• Years of Experience : 5+ years ( PHARMA MANDATORY )


• Shift Timing : Day shift IST, from 12pm


• Work Mode : Hybrid (3 Days from Office Weekly)


• Mandatory Skills:


• Databricks


• SQL


• PySpark

Good to Have Skills:

• Data Lakehouse Architecture


• Unity Catalog or similar data governance tools


• SQL development & performance tuning with large datasets


• Git for version control


• Azure Databricks or Databricks on AWS


• Structured streaming in Spark


• Azure Purview or equivalent governance tools


• Automation experience with Terraform/dbx


• Databricks Notebooks


• Data documentation and dictionary practices

Role Overview / Job Summary:

We are looking for an experienced Databricks SQL Engineer with a Pharma or Life Sciences background to join our offshore Data Engineering team. This role focuses on building efficient, scalable SQL-based data models and pipelines using Databricks SQL, Spark SQL, and Delta Lake. The ideal candidate will play a key role in transforming raw data into valuable analytical insights, enabling critical decision-making across pharma-related business functions.

• Key Responsibilities / Job Responsibilities:


• Design and optimize SQL queries and data models in Databricks for large-scale datasets


• Develop and maintain robust ETL/ELT pipelines using Databricks workflows


• Implement Delta Lake and Unity Catalog for secure and governed data assets


• Ensure data quality via validation, testing, and monitoring mechanisms


• Optimize performance and cost for the data lakehouse environment


• Collaborate with stakeholders to support analytics and business needs


• Deploy notebooks and SQL workflows using CI/CD best practices


• Document pipelines, queries, and data models to foster self-service