AI Platform Engineer II

GSK; Bengaluru; On-site; INR 600,000 - 900,000; Full time

Job summary

GSK in Bengaluru seeks an Enterprise AI Platform Engineer to scale AI services with reliability, security, and cost efficiency. You will own gateway endpoints, model endpoints, and context services, driving automation and governance by design for enterprise-scale AI

You will mentor junior engineers, work with Kubernetes, Terraform, GitOps, and CI/CD, and collaborate on security and data protection for cloud AI workloads. This role demands strong Python skills and experience with GenAI workloads.

Qualifications

• 6+ years in production SaaS/cloud/platform engineering with 2+ years on AI/GenAI workloads.
• Proficiency in Python; working knowledge of Go/TypeScript/Java.
• Experience with Kubernetes, IaC, GitOps, and modern CI/CD.

Responsibilities

• Own platform areas ensuring reliability, security, and cost efficiency of AI services.
• Operate gateways, model endpoints, and context services; automate routine work.
• Mentor junior engineers and contribute to platform governance and design.

Skills

Platform reliability

Python

Go/TypeScript/Java

Kubernetes

Terraform

CI/CD

API gateways

MCP & Agents

Observability

Security engineering

Education

Bachelor’s degree in CS/Software Engineering

Master’s degree in CS/Distributed Systems (advantage)

Tools

Kubernetes

Terraform

GitOps

CI/CD tooling

OpenTelemetry/Grafana/Prometheus

Job description

Job Purpose

As Enterprise AI’s delivery portfolio grows and GenAI and agentic solutions move from pilot to production, the platform must scale reliably and safely. The AI Platform Engineer owns significant areas of that platform — ensuring they operate at SLO, building automation against routine operations work, embedding security and responsible AI controls into the platform layer, and contributing to the vendor and standards conversations that shape the platform’s direction.

Owns significant platform areas with genuine accountability for reliability, security, performance, and cost efficiency of AI services — not just task execution. Makes AI consumable at enterprise scale by operating the gateways, model endpoints, and context services through which every team reaches models, tools, and data. Builds platform leverage through automation, self-service, and reusable components that reduce manual operations work across the team. Embeds governance by design so that AI security, data protection, and responsible AI controls are enforced by the platform rather than negotiated project by project.

Develops the next generation by mentoring junior and mid-level platform engineers, building team capability over time.

Responsibilities

• At least 6 years of experience running SaaS, cloud, or platform-engineering services in a production setting, including at least 2 years operating AI/ML or GenAI workloads or services.
• Strong proficiency in Python; working proficiency in at least one additional language (for example, Go, TypeScript, or Java).
• Hands‑on experience with Kubernetes and container platforms, Infrastructure‑as‑Code (Terraform; Bicep a plus), GitOps, and modern CI/CD.
• Hands‑on experience operating API gateways or AI/LLM gateways, including routing, rate limiting, authentication, and policy enforcement for AI traffic.
• Working knowledge of Model Context Protocol (MCP) and agentic patterns — tool calling, orchestration, and agent frameworks — and of how context is retrieved, managed, and governed for LLM applications.
• Experience operating production services with defined SLOs, observability, and incident management.
• Daily use of AI coding agents (Claude Code, GitHub Copilot, Databricks AI Assistant) as a primary development mode.
• Solid understanding of identity and access management, secrets management, and data protection for cloud and AI services.

Required skills

• Platform & Cloud: Kubernetes, containers, Terraform, GitOps, CI/CD, DevSecOps, platform reliability engineering, and at least one major cloud (Azure preferred) with multi‑cloud and hybrid architecture awareness.
• AI Gateway & API Management: API gateway patterns, AI/LLM gateway architecture and operations, traffic management, and policy enforcement.
• GenAI Operations: LLM deployment, versioning, and monitoring; prompt and evaluation workflows; RAG architectures; vector search fundamentals.
• MCP & Agents: Model Context Protocol, tool calling, workflow orchestration, and an understanding of agent orchestration frameworks and context engineering.
• Observability: Metrics, logging, tracing, and alerting (for example, OpenTelemetry, Prometheus, Grafana, or cloud-native equivalents) applied to AI services.
• Security: IAM, OAuth/OIDC, secrets management, network security, and data privacy controls for AI workloads.

Education

Bachelor’s degree in Computer Science, Software Engineering, or equivalent practical experience. Master’s degree in Computer Science, Distributed Systems, or SRE is advantageous.

Preferred skills

• Azure AI services (Azure OpenAI/AI Foundry, Azure API Management), with AWS and GCP AI services (for example, Bedrock, Google Cloud AI platform) desired.
• Model serving and GPU infrastructure: inference runtimes (for example, vLLM, KServe, Triton), GPU scheduling, and autoscaling.
• Vector and retrieval stacks: vector databases and hybrid search (for example, pgvector, Azure AI Search, OpenSearch, or dedicated vector stores).
• Agent and LLM frameworks: LangChain/LangGraph, Microsoft Agent Framework, or comparable; agent interoperability protocols; evaluation tooling.
• Gateway technologies: Kong AI Gateway or comparable (for example, Envoy-based gateways, LiteLLM, Portkey, Azure API Management).
• Platform tooling: Databricks, policy‑as‑code (OPA/Kyverno), service mesh, internal developer platforms (for example, Backstage), and FinOps for AI (token economics and unit-cost reporting).
• AI security & resilience: guardrail frameworks, AI red‑testing, and resilience testing of AI services.

Why GSK?

Uniting science, technology and talent to get ahead of disease together. GSK is a global biopharma company with a purpose to unite science, technology and talent to get ahead of disease together. We aim to positively impact the health of 2.5 billion people by the end of the decade, as a successful, growing company where people can thrive. We get ahead of disease by preventing and treating it with innovation in specialty medicines and vaccines. We focus on four therapeutic areas: respiratory, immunology and inflammation; oncology; HIV; and infectious diseases – to impact health at scale. People and patients around the world count on the medicines and vaccines we make, so we’re committed to creating an environment where our people can thrive and focus on what matters most. Our culture of being ambitious for patients, accountable for impact and doing the right thing is the foundation for how, together, we deliver for patients, shareholders and our people.

Inclusion at GSK

As an employer committed to Inclusion, we encourage you to reach out if you need any adjustments during the recruitment process. Please contact our Recruitment Team at [e-mail] to discuss your needs.

We are a global biopharma company with a special purpose – to unite science, technology and talent to get ahead of disease together – so we can positively impact the health of billions of people and deliver stronger, more sustainable shareholder returns – as an organisation where people can thrive. Getting ahead means preventing disease as well as treating it, and we aim to impact the health of 2.5 billion people around the world in the next 10 years. Our success absolutely depends on our people. While getting ahead of disease together is about our ambition for patients and shareholders, it’s also about making GSK a place where people can thrive. We want GSK to be a place where people feel inspired, encouraged and challenged to be the best they can be. A place where they can be themselves – feeling welcome, valued and included. Where they can keep growing and look after their wellbeing. So, if you share our ambition, join us at this exciting moment in our journey to get Ahead Together.