Senior Data Engineer – Data & AI Platforms

Novartis AG; Hyderabad; Hybrid; INR 3,000,000 - 5,400,000; Full time

Job summary

Novartis AG is seeking a Senior Data Engineer for Data & AI Platforms in Hyderabad. You will design, build, and scale enterprise-grade data platforms enabling analytics, AI, and business insights. Work across Snowflake, AWS, Python, and Spark to deliver secure, high-performing data products.

You will implement governance, metadata, lineage, and security controls while collaborating with product owners and platform teams to drive innovation and engineering excellence.

Qualifications

• 7+ years of experience building modern data solutions with Snowflake and Python, on cloud platforms.
• Strong ETL/ELT, data modelling, orchestration, and performance optimization.
• Hands-on AWS services including Glue, S3, Lambda, Step Functions.
• Experience implementing data governance, metadata management, lineage, compliance and security controls.
• Familiarity with Generative AI, ML ops, and automation concepts.

Responsibilities

• Design, build, and optimize scalable data pipelines using AWS, Snowflake, Python, and Spark.
• Develop batch, event-driven, and distributed data processing solutions for enterprise data products.
• Deliver reliable, high-performance data platforms that support analytics, AI, and business insights.
• Implement data quality frameworks, monitoring, error handling, metadata management, and lineage.
• Enable governance through data cataloging, access controls, auditability, and compliance standards.
• Support AI/ML initiatives via feature engineering and data pipeline development.
• Build reusable data assets and automation to accelerate delivery and efficiency.
• Apply CI/CD, automated testing, version control, and code reviews.

Skills

Analytics

AI

Data Engineering

Data Pipelines

Data Science

Emerging Technologies

Generative AI

Machine Learning

Natural Language

Snowflake GenAI

Tools

Snowflake

AWS

Glue

S3

Lambda

Step Functions

Workflow Orchestration Tools

Job description

Job Description Summary #LI-Hybrid

Location: Hyderabad, India

Number of Openings: 4

Relocation Support: Yes

Imagine building the data foundations that power the next generation of artificial intelligence and digital innovation. As a Senior Data Engineer – Data & AI Platforms, you will play a pivotal role in designing and scaling enterprise-grade data platforms that enable advanced analytics, artificial intelligence, and business-critical insights. Working across cloud technologies, Snowflake, distributed processing, governance, and AI-enabled solutions, you'll transform complex data challenges into secure, high-performing, and reusable products. If you're passionate about modern data engineering, eager to work with cutting-edge technologies, and motivated by delivering real business impact, this is an opportunity to shape the future of data and AI at scale.

Key Responsibilities

• Design, build, and optimize scalable data pipelines using Amazon Web Services, Snowflake, Python, and Apache Spark.
• Develop batch, event-driven, and distributed data processing solutions for enterprise-wide data products.
• Deliver reliable, high-performance data platforms that support analytics, artificial intelligence, and business insights.
• Implement data quality frameworks, monitoring, error handling, metadata management, and lineage capabilities.
• Enable strong governance through data cataloging, access controls, auditability, and compliance standards.
• Support artificial intelligence and machine learning initiatives through feature engineering and data pipeline development.
• Build reusable data assets and automation solutions that accelerate delivery and operational efficiency.
• Apply engineering best practices including version control, continuous integration, automated testing, and code reviews.
• Collaborate with product owners, architects, business stakeholders, and platform teams to deliver trusted data solutions.
• Mentor engineers and contribute to engineering standards, innovation, and technical excellence across the team.

Essential Requirements

• 7+ Years experience building modern data solutions using Snowflake, Structured Query Language, Python, Apache Spark, and cloud technologies.
• Strong expertise in extract, transform, load and extract, load, transform processes, data modelling, orchestration, and performance optimization.
• Hands-on experience with Amazon Web Services services including Glue, Simple Storage Service, Lambda, Step Functions, and workflow orchestration tools.
• Experience implementing data governance, metadata management, lineage, compliance, and security controls using governance platforms.
• Familiarity with artificial intelligence and machine learning technologies, including Generative Artificial Intelligence, machine learning operations, and automation concepts.
• Experience applying continuous integration, continuous delivery, automated testing, version control, and cloud-native engineering practices.

Desirable Requirements

• Experience supporting Generative Artificial Intelligence, Retrieval-Augmented Generation, or artificial intelligence-driven automation solutions.
• Experience mentoring engineers and driving adoption of engineering best practices across teams.
• Commitment to Diversity and Inclusion: Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.

Skills Desired

• Analytics
• Artificial Intelligence (AI)
• Data Engineering
• Data Pipelines
• Data Science
• Emerging Technologies
• Generative AI
• Machine Learning (ML)
• Natural Language
• Snowflake GenAI

Accessibility and Accommodation

Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities.

Commitment to Diversity and Inclusion

Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.

Company Culture

Improving the lives of people living with disease takes more than innovative science. It takes a focus on the needs of people and a community committed to meeting them. It takes a team of people like you. Working together. Learning together. Thriving together. Discover how you can join us in changing people’s lives.

In the context of China Cross-Border Data Transfer (CBDT) policy, if you need to apply for a position in China, please go to the local Recruiting System TaleNov.