Senior Data Engineer – Data & AI Platforms

Novartis AG; Hyderabad; On-site; INR 3,000,000 - 5,400,000; Full time

Job summary

Novartis AG in Hyderabad, India seeks a senior data engineer to design and optimize scalable data pipelines using AWS, Snowflake, Python and Apache Spark. You will deliver enterprise-grade data platforms that support analytics, AI initiatives, and business insights.

The role emphasizes governance, data quality, metadata, lineage, and collaboration with product owners and platform teams. Relocation support is available for the right candidate.

Qualifications

• 7+ years experience building modern data solutions using Snowflake, SQL, Python, Spark, and cloud technologies.
• Strong expertise in ETL, data modelling, orchestration, and performance optimization.
• Hands-on AWS services including Glue, S3, Lambda, Step Functions, and workflow orchestration.

Responsibilities

• Design, build, and optimize scalable data pipelines using AWS, Snowflake, Python, and Spark.
• Develop batch, event-driven, and distributed data processing solutions for enterprise data products.
• Deliver reliable, high-performance data platforms supporting analytics, AI, and business insights.
• Implement data quality frameworks, monitoring, metadata management, and lineage capabilities.
• Enable governance through data cataloging, access controls, auditability, and compliance.

Skills

Mentoring engineers

Data modeling

ETL orchestration

Problem solving

Stakeholder communication

Tools

Snowflake

Python

Apache Spark

AWS

Glue

S3

Lambda

Step Functions

Job description

Job Description Summary

Location: Hyderabad, India
Number of Openings: 4
Relocation Support: Yes

Job Description

Key Responsibilities

• Design, build, and optimize scalable data pipelines using Amazon Web Services, Snowflake, Python, and Apache Spark.
• Develop batch, event-driven, and distributed data processing solutions for enterprise-wide data products.
• Deliver reliable, high-performance data platforms that support analytics, artificial intelligence, and business insights.
• Implement data quality frameworks, monitoring, error handling, metadata management, and lineage capabilities.
• Enable strong governance through data cataloging, access controls, auditability, and compliance standards.
• Support artificial intelligence and machine learning initiatives through feature engineering and data pipeline development.
• Build reusable data assets and automation solutions that accelerate delivery and operational efficiency.
• Apply engineering best practices including version control, continuous integration, automated testing, and code reviews.
• Collaborate with product owners, architects, business stakeholders, and platform teams to deliver trusted data solutions.
• Mentor engineers and contribute to engineering standards, innovation, and technical excellence across the team.

Essential Requirements

• 7+ Years experience building modern data solutions using Snowflake, Structured Query Language, Python, Apache Spark, and cloud technologies.
• Strong expertise in extract, transform, load and extract, load, transform processes, data modelling, orchestration, and performance optimization.
• Hands-on experience with Amazon Web Services services including Glue, Simple Storage Service, Lambda, Step Functions, and workflow orchestration tools.
• Experience implementing data governance, metadata management, lineage, compliance, and security controls using governance platforms.
• Familiarity with artificial intelligence and machine learning technologies, including Generative Artificial Intelligence, machine learning operations, and automation concepts.
• Experience applying continuous integration, continuous delivery, automated testing, version control, and cloud-native engineering practices.

Desirable Requirements

• Experience supporting Generative Artificial Intelligence, Retrieval-Augmented Generation, or artificial intelligence-driven automation solutions.
• Experience mentoring engineers and driving adoption of engineering best practices across teams.

Commitment to Diversity and Inclusion:
Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.

Accessibility and accommodation
Novartis is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the recruitment process, or in order to perform the essential functions of a position, please send an e-mail to [e-mail] and let us know the nature of your request and your contact information. Please include the job requisition number in your message

Skills Desired

Analytics, Artificial Intelligence (AI), Data Engineering, Data Pipelines, Data Science, Emerging Technologies, Generative AI, Machine Learning (ML), Natural Language, Snowflake GenAI