Data Engineer

IND - 2028 Takeda Innovations India Private Limited; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Takeda Innovations India Private Limited in Bengaluru seeks an experienced Data Engineer to design, develop, and maintain scalable data pipelines using Databricks, PySpark, and SQL. You will build analytics-ready datasets, ensure data quality, and collaborate with analytics, product, and business teams to enable enterprise data products.

You will work with cloud platforms (AWS/Azure), follow enterprise frameworks, and contribute to testing, documentation, and best practices while aligning with

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field.
• 5+ years of experience in data engineering, data warehousing, or large‑scale data platform development.
• Strong hands‑on experience with Databricks and distributed data processing.
• Strong hands‑on experience with PySpark for pipeline development and transformation of large datasets.
• Strong hands‑on experience with SQL, including joins, aggregations, optimization, and analytical data processing.
• Experience building and maintaining data pipelines for batch processing; exposure to streaming is a plus.
• Experience working with existing enterprise frameworks, shared libraries, and engineering standards.
• Experience reading, understanding, debugging, and enhancing existing code developed by other teams.
• Experience with cloud data platforms such as AWS or Azure.
• Experience working in agile, cross‑functional engineering environments.

Responsibilities

• Design, develop, test, and maintain scalable data pipelines and integrations using Databricks, PySpark, and SQL.
• Build datasets optimized for analytics, BI, and downstream consumption while ensuring data quality, reconciliation, and production reliability.
• Work within established data frameworks, design patterns, and reusable components created by other engineering teams.
• Read, understand, troubleshoot, and extend existing codebases and pipeline logic in line with engineering standards.
• Collaborate with analytics, product, and business teams to support data models and data products for enterprise use cases.
• Contribute to unit, integration, and performance testing, documentation, and engineering best practices.
• Partner with platform, architecture, security, and DevOps teams to deploy and support pipeline solutions in cloud environments.
• Troubleshoot data and pipeline issues and drive continuous improvement in performance, scalability, and maintainability.

Skills

PySpark

SQL

Data modeling

Data quality controls

Testing

Education

Bachelor’s or Master’s degree in CS/Engineering/IS

Tools

Databricks

AWS

Azure

Kafka

Terraform

Job description

PRIMARY OBJECTIVES:

Build and maintain scalable data pipelines and datasets that support analytics, reporting, and downstream business systems. Develop data solutions on Databricks using established engineering patterns, reusable frameworks, and enterprise standards. Ensure reliable, high-quality, and performant data delivery across batch and, where relevant, streaming use cases. Support Takeda’s data transformation journey through strong engineering practices, collaboration, and scalable platform-aligned development.

RESPONSIBILITIES:

Design, develop, test, and maintain scalable data pipelines and integrations using Databricks, PySpark, and SQL. Build datasets optimized for analytics, BI, and downstream consumption while ensuring data quality, reconciliation, and production reliability. Work within established data frameworks, design patterns, and reusable components created by other engineering teams. Read, understand, troubleshoot, and extend existing codebases and pipeline logic in line with engineering standards. Collaborate with analytics, product, and business teams to support data models and data products for enterprise use cases. Contribute to unit, integration, and performance testing, documentation, and engineering best practices. Partner with platform, architecture, security, and DevOps teams to deploy and support pipeline solutions in cloud environments. Troubleshoot data and pipeline issues and drive continuous improvement in performance, scalability, and maintainability.

SCOPE OF SUPERVISION:

NUMBER SUPERVISED WORKERS Direct Indirect Employees 0-3 0-3 Non-Employees 0-3 0-3

EDUCATION AND EXPERIENCE:

Bachelor’s or Master’s degree in Computer Science, Engineering, Information Systems, or related field. 5+ years of experience in data engineering, data warehousing, or large‑scale data platform development. Strong hands‑on experience with Databricks and distributed data processing. Strong hands‑on experience with PySpark for pipeline development and transformation of large datasets. Strong hands‑on experience with SQL, including joins, aggregations, optimization, and analytical data processing. Experience building and maintaining data pipelines for batch processing; exposure to streaming is a plus. Experience working with existing enterprise frameworks, shared libraries, and engineering standards. Experience reading, understanding, debugging, and enhancing existing code developed by other teams. Experience with cloud data platforms such as AWS or Azure. Experience working in agile, cross‑functional engineering environments.

KEY SKILLS AND COMPETENCIES:

Strong proficiency in PySpark and SQL; Python alone is not sufficient for this role. Strong understanding of distributed data processing, performance optimization, and scalable pipeline design. Ability to work effectively within predefined patterns, frameworks, and architectural guardrails. Strong code reading and code comprehension skills across shared enterprise codebases. Good understanding of data modeling, schema design, and data quality controls. Strong engineering discipline in testing, version control, documentation, and maintainable development. Strong problem‑solving skills and ability to troubleshoot production data issues. Effective communication and collaboration with technical and non‑technical stakeholders.

NICE TO HAVE:

• Experience with streaming technologies such as Spark Structured Streaming or Kafka.
• Experience with orchestration and workflow tools in enterprise data environments.
• Experience with Infrastructure as Code, preferably Terraform.
• Experience designing and developing API‑based integrations.

LICENSES/CERTIFICATIONS:

• Preferred - Databricks Certified Data Engineer Associate / Professional
• Preferred - AWS or Azure Data Engineering certification

PHYSICAL DEMANDS:

• N/A

TRAVEL REQUIREMENTS:

• Access to transportation to attend meetings.
• Ability to fly to meetings regionally and globally.

Locations:

IND - Bengaluru Worker Type Employee Worker Sub‑Type Regular Time Type Full time

Takeda is an industry‑leading, global pharmaceutical company with an unwavering dedication to putting patients at the center of everything we do. We live our values of Takeda‑ism – Integrity, Fairness, Honesty, and Perseverance – and are united by our mission to strive towards Better Health and a Brighter Future for people worldwide through leading innovation in medicine. Here, everyone matters and you will be a vital contributor to our inspiring, bold mission. At Takeda, you will make an impact on people’s lives – including your own. Takeda is an equal opportunity employer. For applicants of U.S and Puerto Rico positions: Click here to learn about our commitment to Equal Employment Opportunity (EEO). If you are limited in the ability to use our job application tool, or otherwise require a reasonable accommodation for a disability please click here.