Senior Specialist, Data Engineering

MSD; Hyderabad; Hybrid; INR 3,500,000 - 7,000,000; Full time

Job summary

MSD Hyderabad is seeking a Senior Specialist, Data Engineering to lead the design, construction, and optimization of scalable data pipelines.

The role focuses on batch and real-time processing on Databricks and AWS to deliver clean, structured data for advanced analytics and commercial insights.

Qualifications

• 5-8 years of experience in data engineering or related field.
• Experience designing and building scalable data pipelines.

Responsibilities

• Leads the design, construction, and maintenance of complex, scalable data pipeline architectures—ingesting, processing, and delivering high-quality data to stakeholders.
• Architects and optimize batch and real-time processing pipelines on Databricks and AWS, ensuring large-scale datasets are highly structured and ready for analytics.
• Establishes engineering standards and best practices to share and scale across the organization.
• Drives technical delivery of high-impact data analytics initiatives from ingestion to reporting.
• Develops deep knowledge of supported technologies and dependencies across teams, Databricks, and AWS.
• Collaborates with peer platforms and leadership to pilot and implement modern data trends.
• Translates business goals into robust technical architectures that unlock value.
• Manages trust-based relationships with business partners and stakeholders.
• Monitors market developments to prototype next-gen pipeline patterns and reduce costs.
• Mentors junior engineers and builds a community of practice for cloud analytics.
• Ensures delivery with quality, timelines, and compliance with security standards.
• Leads proof-of-concept development and defines success metrics for new tech.
• Applies expertise in Salesforce CRM integrations for advanced commercial analytics.

Skills

PySpark

Python

SQL

CI/CD

Data modeling

Databricks

AWS

IDMC

ETL

Data warehousing

Tools

Databricks

AWS

IDMC

Job description

The Opportunity

Based in Hyderabad, joining a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Lead an organization driven by digital technology and data-backed approaches that supports a diversified portfolio of prescription medicines, vaccines, and animal health products.

Job Description

Senior Specialist, Data Engineering

Based in Hyderabad, joining a global healthcare biopharma company and be part of a 130-year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Lead an organization driven by digital technology and data-backed approaches that supports a diversified portfolio of prescription medicines, vaccines, and animal health products.

Role Overview

Do you see the bigger picture and how teams collectively deliver on business needs and goals? Are you a perfect mix of creativity, dedication, persistence, people and passion? If so, Senior Data Engineer role is a great career move to advance your communications and change skills while helping to establish a global team’s presence in Hyderabad! Our IT team is transforming the way our company uses the power of leading-edge science to save and improve lives around the world.

What Will You Do In This Role

• Leads the design, construction, and maintenance of complex, scalable data pipeline architectures—ingesting, processing, and delivering high-quality data to stakeholders.
• Architects and optimize batch and real-time processing pipelines on Databricks and AWS, ensuring large-scale datasets are highly structured and ready for advanced analytics.
• Establishes, documents, and champions engineering standards, defining best practices to share and scale across the broader organization.
• Drives the technical delivery of high-impact data analytics initiatives, ensuring robust execution from ingestion to reporting.
• Develops deep, systemic knowledge of supported technologies; masters the architectural complexity and critical dependencies between multiple teams, Databricks platforms, and AWS cloud infrastructure.
• Collaborates intensively with peer platforms and technical leadership to evaluate, pilot, and implement modern data trends and methodologies within the corporate ecosystem.
• Translates strategic stakeholder business goals into technical architectures, designing robust solutions that directly unlock business value.
• Establishes and actively manages trust-based relationships with key business partners, product owners, and stakeholders.
• Monitors global data engineering market developments, identifying and prototyping next-generation pipeline patterns to increase performance and reduce operational costs.
• Fosters and builds a technical "community of practice", leveraging lessons learned from complex cloud analytics deployments to mentor junior engineers.
• Maintains accountability for team delivery, ensuring all engineered solutions meet rigorous quality standards, strict timelines, compliance regulations, and exceptional user experiences.
• Spearheads innovative experimentation, leading proof-of-concept development and defining quantitative, measurable success criteria for new technologies.
• Applies deep commercial domain expertise, with a specialized focus on designing data assets that support Salesforce CRM integrations and advanced commercial analytics.

What Should You Have

• 5-8 years of experience.
• Brilliant short and long-form writing and storytelling skills, capable of capturing authentic voice in written communication.
• Strong project management skills and proven ability to manage multiple projects at once in a fast-paced, collaborative, deadline-oriented environment.
• Able to quickly grasp information and develop clear communication with minimal guidance.
• Outstanding attention to detail. Our technology teams operate as business partners, proposing ideas and innovative solutions that enable new organizational capabilities. We collaborate internationally to deliver services and solutions that help everyone be more productive and enable innovation.
• High-Scale Languages Expert in PySpark, Python, and advanced SQL with a strong focus on distributed computing and query optimization.
• Advanced IDMC Engineering Proven experience designing complex, high-throughput ETL/ELT pipelines using IDMC, including advanced mapping configurations, parameterization, and performance optimization.
• Databricks Lakehouse Expert Deep knowledge of Databricks optimization, Unity Catalog governance, and Delta Lake formats.
• AWS Cloud Architecting Proven experience designing serverless AWS data infrastructure using Terraform, Lambda, S3, IAM, and Step Functions.
• Salesforce Integration Pipelines Extensive experience building high-volume replication pipelines from Salesforce/Veeva CRM systems, handling polymorphic keys and schema shifts.
• Advanced Data Modeling Expertise in enterprise semantic layers, slowly changing dimensions (SCD Type 2), and data warehousing architectures.
• CI/CD & Testing Automation Experience designing robust GitOps workflows, automated testing frameworks, and continuous deployment pipelines.
• Technical Leadership Experience writing architectural blueprints (Design documents), defining standards, and mentoring junior engineers.

Primary Skills

SQL, Python, ETL, IDMC, AWS, Data warehousing, Databricks, Data modeling, and CI/CD

Secondary Skills

Communication Skills.

Who We Are

We are known as well-known org Inc., Rahway, New Jersey, USA in the United States and Canada and our company everywhere else. For more than a century, bringing forward medicines and vaccines for many of the world's most challenging diseases. Today, our company continues to be at the forefront of research to deliver innovative health solutions and advance the prevention and treatment of diseases that threaten people and animals around the world.

What We Look For

Imagine getting up in the morning for a job as important as helping to save and improve lives around the world. Here, you have that opportunity. You can put your empathy, creativity, digital mastery, or scientific genius to work in collaboration with a diverse group of colleagues who pursue and bring hope to countless people who are battling some of the most challenging diseases of our time. Our team is constantly evolving, so if you are among the intellectually curious, join us—and start making your impact today.

Required Skills

Amazon Web Services (AWS), CI/CD, Data Modeling, Data Warehousing (DW), Extract Transform & Load (ETL) Tools, Python (Programming Language), Structured Query Language (SQL)

Preferred Skills

Communication

Secondary Language(s) Job Description

#MSDHYDIT

Employee Status

Regular

Relocation

Domestic

VISA Sponsorship

No

Travel Requirements

No Travel Required

Flexible Work Arrangements

Hybrid

Shift

Not Indicated

Valid Driving License

No

Hazardous Material(s)

n/a

Job Posting End Date

09/28/2026

• A job posting is effective until 11 59 59PM on the day BEFORE the listed job posting end date. Please ensure you apply to a job posting no later than the day BEFORE the job posting end date.

Requisition ID

R415369