Senior Data Engineer Data And AI Platforms

Novartis India; Hyderabad; On-site; INR 3,000,000 - 7,000,000; Full time

Job summary

Novartis India is seeking a Senior Data Engineer to design and scale enterprise-grade data platforms that empower analytics, AI, and business insights. You will work across Snowflake, Python, Spark, and AWS services to build secure, high-performing data products and governance frameworks.

The role emphasizes data engineering excellence, collaboration with product and platform teams, and mentoring peers to raise engineering standards across the team.

Qualifications

• 7+ years of experience building modern data solutions.
• Expertise with Snowflake, SQL, Python and Spark for data platforms.
• Hands-on AWS services (Glue, S3, Lambda, Step Functions).
• Experience implementing data governance, metadata, and security controls.

Responsibilities

• Design, build and optimize scalable data pipelines using Snowflake, Python and Spark.
• Develop batch and streaming data processing for enterprise data products.
• Deliver high-performing data platforms enabling analytics and AI insights.
• Implement data quality, lineage, and governance capabilities.
• Collaborate with stakeholders and mentor engineers on best practices.

Skills

Snowflake

SQL

Python

Apache Spark

Cloud technologies

Data governance

Tools

AWS Glue

Amazon S3

AWS Lambda

AWS Step Functions

Job description

Job Description

Location: Hyderabad, India

Number of Openings: 4

Relocation Support: Yes

Summary

Imagine building the data foundations that power the next generation of artificial intelligence and digital innovation. As a Senior Data Engineer – Data & AI Platforms, you will play a pivotal role in designing and scaling enterprise-grade data platforms that enable advanced analytics, artificial intelligence, and business-critical insights. Working across cloud technologies, Snowflake, distributed processing, governance, and AI-enabled solutions, you'll transform complex data challenges into secure, high-performing, and reusable products. If you're passionate about modern data engineering, eager to work with cutting-edge technologies, and motivated by delivering real business impact, this is an opportunity to shape the future of data and AI at scale.

About The Role

Key Responsibilities

• Design, build, and optimize scalable data pipelines using Amazon Web Services, Snowflake, Python, and Apache Spark.
• Develop batch, event-driven, and distributed data processing solutions for enterprise-wide data products.
• Deliver reliable, high-performance data platforms that support analytics, artificial intelligence, and business insights.
• Implement data quality frameworks, monitoring, error handling, metadata management, and lineage capabilities.
• Enable strong governance through data cataloging, access controls, auditability, and compliance standards.
• Support artificial intelligence and machine learning initiatives through feature engineering and data pipeline development.
• Build reusable data assets and automation solutions that accelerate delivery and operational efficiency.
• Apply engineering best practices including version control, continuous integration, automated testing, and code reviews.
• Collaborate with product owners, architects, business stakeholders, and platform teams to deliver trusted data solutions.
• Mentor engineers and contribute to engineering standards, innovation, and technical excellence across the team.

Essential Requirements

• 7+ Years experience building modern data solutions using Snowflake, Structured Query Language, Python, Apache Spark, and cloud technologies.
• Strong expertise in extract, transform, load and extract, load, transform processes, data modelling, orchestration, and performance optimization.
• Hands-on experience with Amazon Web Services services including Glue, Simple Storage Service, Lambda, Step Functions, and workflow orchestration tools.
• Experience implementing data governance, metadata management, lineage, compliance, and security controls using governance platforms.
• Familiarity with artificial intelligence and machine learning technologies, including Generative Artificial Intelligence, machine learning operations, and automation concepts.
• Experience applying continuous integration, continuous delivery, automated testing, version control, and cloud-native engineering practices.

Desirable Requirements

• Experience supporting Generative Artificial Intelligence, Retrieval-Augmented Generation, or artificial intelligence-driven automation solutions.
• Experience mentoring engineers and driving adoption of engineering best practices across teams.

Commitment To Diversity And Inclusion

Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.

Accessibility and accommodation

Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [e-mail] and let us know the nature of your request and your contact information. Please include the job requisition number in your message

Why Novartis

Helping people with disease and their families takes more than innovative science. It takes a community of smart, passionate people like you. Collaborating, supporting and inspiring each other. Combining to achieve breakthroughs that change patients’ lives. Ready to create a brighter future together? https://www.novartis.com/about/strategy/people-and-culture

Benefits and Rewards

Learn about all the ways we'll help you thrive personally and professionally.

Read our handbook (PDF 30 MB)