Senior Principal Machine Learning Engineer

550 Eli Lilly Services India Pvt Ltd; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

550 Eli Lilly Services India Pvt Ltd is seeking a Senior Principal Machine Learning Engineer to guide hands‑on engineering, MLOps, and GenAI initiatives within a dynamic AI engineering team. You will own architecture for agentic systems, drive cross‑team collaboration, and mentor engineers to ensure production‑grade solutions.

The role emphasizes designing scalable backend systems, setting technical standards, and delivering secure, observable, and reliable AI platforms across the organization.

Qualifications

• 11–15 years hands-on experience with architecture‑level ownership across multiple teams.
• Strong Python skills and production‑quality code delivery.
• Proven CI/CD, containerisation, and orchestration for production ML/AI systems.
• Experience deploying LLM‑based apps, prompt engineering, and RAG workflows.

Responsibilities

• Design and build production backend systems for agentic AI applications with scalable API layers.
• Lead resolution of highly complex cross‑system technical challenges and set engineering standards.
• Own MLOps decisions, deployment topology, observability, and GitOps governance.
• Mentor engineers and drive cross‑team architectural decisions for GenAI tooling.

Skills

Hands-on ML engineering

MLOps

GenAI / LLM Ops

Python

AWS cloud

Distributed systems

Education

Bachelor's or Master's in Computer Science/Applications or related

Tools

Databricks

Unity Catalog

Docker

Kubernetes

Git/GitHub

LangGraph

Pinecone

Job description

At Lilly, the work is demanding because patients are waiting. We unite caring with discovery to help make life better for people around the world, knowing that every decision, every detail, and every day matters. Headquartered in Indianapolis, Indiana, our over 50,000 employees around the globe take on complex challenges to discover and deliver life‑changing medicines, strengthen how health is understood and managed, and support the communities we serve. This is hard, urgent, selfless work—but it’s work worth doing. If you’re driven by purpose and ready to bring your best to work that truly matters for patients, we invite you to join us.

Role Overview

We are looking for a Senior Principal Machine Learning Engineer to join the AI Engineering team, with a primary focus on Hands‑On Engineering (MLE) and MLOps & Platform Reliability and GenAI & Agentic Systems. This posting is at level R4 on our engineering ladder — see the level framing below for the expected scope of ownership and impact. Level framing: Recognized expert who mentors others; makes key technical decisions impacting multiple teams; leads resolution of highly complex challenges; cross‑functional influence; may engage with external partners as an authority.

Core Responsibilities

• Design and build production backend systems for agentic AI applications — API layers, backend‑for‑frontend (BFF) patterns, session/state management, and streaming for concurrent multi‑user workloads.
• Lead resolution of highly complex, cross‑system technical challenges.
• Set the technical bar for hands‑on engineering practice across the team.
• Own GitOps and engineering‑governance standards across the team (version control, CI/CD, review, promotion).
• Make key MLOps/platform decisions that affect multiple teams (e.g. deployment topology, observability strategy).
• Drive triage and resolution of complex, cross‑system production incidents.
• Own architecture for agentic AI systems, including routing, policy enforcement, and RAG/knowledge‑registry design.
• Lead evaluation and adoption of new agent frameworks, LLMOps practices, and GenAI tooling across the team.
• Implement authentication/authorization flows for agentic systems (OAuth/OIDC, on‑behalf‑of token exchange, secure credential storage).
• Mentor other engineers on architecture, design patterns, and production engineering practices, and act as a role model for engineering rigor across the wider team.

Key Tools & Technologies

Cloud & Data Infra: AWS (EC2/ECS, S3, Lambda, IAM, CloudWatch or equivalent); Databricks & Unity Catalog. Foundational: Python; Git/GitHub; software engineering best practices; testing; SQL. MLOps & Deployment: Docker, Kubernetes, Prefect; CI/CD (GitHub Actions); production monitoring; model versioning & lineage; GitOps governance. GenAI & Agentic Architecture: Claude or comparable LLMs; LangGraph or comparable agent frameworks; RAG architectures; vector databases (e.g. Pinecone); prompt engineering & evaluation.

Required Qualifications

• 11–15 years of hands‑on experience, with demonstrated growth into architecture‑level ownership spanning multiple teams or systems.
• Strong proficiency in Python and a track record of writing clean, testable, production‑quality code.
• Demonstrated experience owning CI/CD, containerisation, and orchestration for production ML/AI systems.
• Proven experience developing or deploying LLM‑based applications, including prompt engineering, RAG, or agentic workflows.
• Strong working knowledge of containerisation (Docker), orchestration (Kubernetes), and CI/CD pipelines.
• Working knowledge of AWS cloud services and Databricks/Unity Catalog or equivalent enterprise data platforms.
• Excellent verbal and written communication skills.
• Experience working in Agile/Scrum environments.
• Education Bachelor's or Master's degree in Computer Science, Computer Applications, or a related technical field.

Lilly does not discriminate on the basis of age, race, color, religion, gender, sexual orientation, gender identity, gender expression, national origin, protected veteran status, disability or any other legally protected status.

#WeAreLilly At Lilly we strive to ensure our employees are part of a team that cares about them and our shared purpose of making life better for those around the world. How do we do this? We continue to look for ways to include, innovate, accelerate and deliver while maintaining integrity, excellence and respect for people. We hope that you seek to join us on our journey as we create medicine and deliver improved outcomes for patients across the globe! #WeAreLilly