Senior AI-ML Platform Engineer / Tech Lead

Biopharma Careers; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Biopharma Careers is seeking a Senior AI/ML Platform Engineer and Technical Lead to shape our AI/ML platform. You will guide a team of engineers, setting objectives, mentoring, and ensuring timely delivery while balancing hands-on work with leadership.

You will own cloud-native backend development in Python (plus Rust), integrate LLM operations across AWS/Azure, manage CI/CD, Terraform, and security tooling, and align platform governance with enterprise standards.

Qualifications

• 8+ years in software or platform engineering with 2+ years in LLM operations (LLMOps).
• Hands-on with LLM/API gateway tech like LiteLLM.
• Experience with multi-provider cloud AI platforms (Azure OpenAI, Azure AI Foundry, AWS Bedrock).
• Cloud-native on AWS and/or Azure, incl. ECS Fargate, secrets mgmt, relational/non-relational DBs, networking, and load balancing.
• Backend services in Python; async programming; Rust a plus.
• IaC and CI/CD tooling: Docker, Azure DevOps, Terraform, CloudFormation.
• Observability/monitoring: CloudWatch, Prometheus, Grafana, LLM evaluation tools.
• IAM technologies: Entra ID, JWT, OIDC, SSO, API keys.
• Lead engineers, set priorities, ensure scalable, well-governed engineering.

Responsibilities

• Lead a team of engineers, set objectives and develop talent.
• Ensure platform aligns with enterprise standards and governance.
• Define team responsibilities, engineering standards, and governance practices.
• Solve complex engineering challenges by prioritising inputs and coordination across teams.
• Act as a technical liaison across Cloud, Cybersecurity, Governance, and related teams.

Skills

Team leadership

LLMOps

Platform engineering

Cloud architecture

Python backend

Rust (plus)

CI/CD tooling

Terraform/CloudFormation

Docker

Observability

IAM basics

Tools

Docker

Terraform

CloudFormation

Azure DevOps

LiteLLM

ECS Fargate

Azure OpenAI

Azure AI Foundry

AWS Bedrock

CloudWatch

Job description

Senior AI/ML Platform Engineer / Technical Lead (all genders)

Your Role

As a Senior AI/ML Platform Engineer and Technical Lead, you will be at the heart of building and evolving the AI/ML platform that powers intelligent capabilities across the organisation. In this role, you will lead a team of professional engineers, setting clear objectives, supporting their development, and being accountable for the quality, accuracy, and timeliness of the team's output. You will solve complex, operationally important engineering challenges by filtering and prioritising inputs from a wide range of internal and external sources, drawing on an in-depth understanding of how platform sub-functions work together. Acting as a key technical liaison across Cloud, Cybersecurity, Governance, and adjacent engineering teams, you will ensure the platform remains aligned with enterprise standards and emerging best practices. Your decisions will be guided by resource availability and organisational objectives, and you will contribute to defining team responsibilities, engineering standards, and platform governance practices that raise the quality bar across closely related teams.

Who You Are

• 8 or more years of relevant industry experience in software or platform engineering, including at least 2 years working with large language model operations (LLMOps) in a production environment.
• Hands‑on experience with LLM/API gateway technologies such as LiteLLM or comparable solutions, and with multi‑provider integration across major cloud AI platforms including Azure OpenAI, Azure AI Foundry, and AWS Bedrock.
• Practical experience with cloud‑native technologies on AWS and/or Azure, including container orchestration (such as ECS Fargate), secrets management, relational and non‑relational databases, networking, and load balancing.
• Proficiency in developing production‑grade backend services using Python and asynchronous programming frameworks; experience with Rust is a plus.
• Experience with infrastructure‑as‑code and CI/CD tooling, including containerisation with Docker, pipeline automation with Azure DevOps, and cloud provisioning frameworks such as Terraform or CloudFormation.
• Familiarity with observability and monitoring tools used in AI/ML environments, such as CloudWatch, Prometheus, Grafana, or LLM‑specific evaluation tooling.
• Experience with identity and access management technologies, including Entra ID, JWT, OIDC, SSO, API keys, and related IAM methods.
• Demonstrated ability to lead professional engineers, set team priorities, and drive platform quality, balancing hands‑on technical depth with team accountability and a focus on scalable, well‑governed engineering.