Assoc Director- Platform & Data Engineer

IN10 (FCRS = IN010) Novartis Healthcare Private Limited; Hyderabad; Vor Ort; INR 1.800.000 - 3.000.000; Vollzeit

Zusammenfassung

Novartis Healthcare Private Limited seeks a senior data engineering leader to design and deliver enterprise data platforms and AI-ready solutions using AWS, Databricks, Snowflake, Spark, and Python. You will build scalable data pipelines, data products, RAG and agentic AI capabilities with governance and security at the core.

The role emphasizes production-grade data platforms, CI/CD, IaC, observability, and end-to-end ownership across ERP/CRM integrations while mentoring engineers and driving

Qualifikationen

• 12+ years of software or data engineering delivering large-scale data platforms.
• Hands-on expertise with Python, SQL, data modeling, ETL/ELT, CDC, batch, streaming and event-driven architectures.
• Proven experience with Databricks, Delta Lake, Snowflake in enterprise environments.
• Deep knowledge of AWS cloud services, IaC, security, governance, and automation.
• Experience implementing CI/CD, testing, monitoring, and data quality controls.
• Familiarity with Generative AI, RAG, embeddings, and vector search is a plus.
• Strong stakeholder engagement, leadership, and delivery mindset.

Aufgaben

• Design, build, and optimize scalable data pipelines (batch, streaming, CDC, event-driven).
• Architect secure, resilient data platforms using Spark, Databricks, Delta Lake, and Snowflake.
• Lead data integration across ERP/CRM SaaS apps with governance and security in mind.
• Develop AI-ready foundations (RAG, vector retrieval, context engineering, LLM integration).
• Drive CI/CD, IaC, observability, and end-to-end ownership of data products.

Kenntnisse

Python

SQL

ETL/ELT

CDC

Streaming

Batch

Apache Spark

Databricks

Delta Lake

Snowflake

AWS cloud

CI/CD

Infrastructure as Code

Security

Observability

Data governance

Metadata management

APIs

SaaS integrations

Context engineering

Agentic workflows

RAG architectures

Vector search

LLM integration

Leadership

Stakeholder management

Ausbildung

Bachelor’s/Master’s in CS/SE/Data Eng

Tools

Python

SQL

Databricks

Delta Lake

Snowflake

Spark (PySpark)

AWS cloud

Jobbeschreibung

Job Description Summary This role leads the design and delivery of enterprise data platforms and AI-ready solutions using AWS, Databricks, Snowflake, Spark, and Python. It is a highly hands-on technical position focused on building scalable data pipelines, integrations, data products, RAG and agentic AI capabilities, while ensuring strong governance, security, reliability, automation, and performance

Job Description Major Accountabilities

Design, build, and optimize scalable batch, streaming, CDC, and event-driven data pipelines using modern data engineering best practices and production-grade Python and SQL. Architect secure, resilient, high-performance data platforms and translate business and technical requirements into scalable cloud-based solutions. Lead hands-on development and optimization of Databricks, Apache Spark, Delta Lake, and Lakehouse solutions, ensuring reliability, performance, and cost efficiency. Design and implement Snowflake data engineering solutions, including ingestion, transformation, governance, orchestration, and secure data consumption patterns. Engineer enterprise data platforms on AWS, leveraging cloud-native services to deliver secure, automated, observable, and highly available data solutions. Develop reusable integration frameworks, APIs, CDC processes, and connectivity patterns across enterprise applications, SaaS platforms, governance tools, ERP, and CRM systems. Build AI-ready data foundations, including RAG pipelines, vector retrieval, context engineering, and agentic workflows, enabling enterprise AI and GenAI use cases. Drive engineering excellence through CI/CD, Infrastructure as Code, security-by-design, observability, governance, mentoring, and end-to-end ownership of data products and platform capabilities.

Minimum Requirements

Bachelor's or Master's degree in Computer Science, Software Engineering, Data Engineering, Information Technology, or a related discipline, or equivalent practical experience. 12+ years of experience in software engineering and/or data engineering with proven delivery of large-scale production data platforms. Advanced hands-on expertise in Python, SQL, data modeling, ETL/ELT, CDC, batch, streaming, and event-driven architectures. Strong experience with Apache Spark (PySpark), distributed data processing, performance tuning, and troubleshooting. Proven hands-on experience with Databricks, Delta Lake, and Snowflake in enterprise-scale environments. Deep knowledge of AWS cloud services, cloud-native data architectures, security, observability, Infrastructure as Code, and automation. Experience implementing CI/CD pipelines, automated testing, monitoring, governance, data quality, security controls, and operational support practices. Practical exposure to Generative AI technologies, including RAG architectures, embeddings, vector search, LLM integration, context engineering, and agentic workflows. Strong understanding of enterprise integration patterns, APIs, SaaS integrations, metadata management, lineage, data governance, and access control frameworks. Excellent stakeholder management, communication, mentoring, problem-solving, and delivery leadership skills with a highly hands-on engineering mindset.

Why Novartis?

Our purpose is to reimagine medicine to improve and extend people’s lives and our vision is to become the most valued and trusted medicines company in the world. How can we achieve this? With our people. It is our associates that drive us each day to reach our ambitions. Be a part of this mission and join us! Learn more here: https://www.novartis.com/about/strategy/people-and-culture

Commitment to Diversity and Inclusion: Novartis is committed to building an outstanding, inclusive work environment and diverse teams' representative of the patients and communities we serve.

Join our Novartis Network

If this role is not suitable to your experience or career goals but you wish to stay connected to hear more about Novartis and our career opportunities, join the Novartis Network here: https://talentnetwork.novartis.com/network

Skills Desired

Databricks Platform, Snowflake (Platform)

Improving the lives of people living with disease takes more than innovative science. It takes a focus on the needs of people and a community committed to meeting them. It takes a team of people like you. Working together. Learning together. Thriving together. Discover how you can join us in changing people’s lives.