Hybrid AI Platform Engineer - LLM Gateway & Observability

EXL; Dublin; Hybrid; EUR 120,000 - 170,000; Full time

Benefits offered by this job

Competitive compensation

Bonus

Private healthcare

Life assurance

Income protection

Pension

Learning & development

Hybrid work model

Equal opportunity employer

Job summary

EXL is seeking a seasoned Platform Engineer to operate and optimize our AI Gateway and Agent Builder platforms. You will serve as SME for AI tooling, lead enablement sessions, and ensure platform reliability across hybrid cloud environments.

Ideal candidates have 3–6 years in platform engineering or DevOps, hands-on experience with LLM gateways, and familiarity with low-code agent builders. Join a global data and AI leader delivering secure, scalable solutions.

Qualifications

• 3–6 years in platform engineering, DevOps, or technical operations.
• Hands-on with LLM gateway or AI observability platforms.
• Familiarity with agentic AI platforms and low-code/no-code builders.
• Strong knowledge of LLM APIs, prompt routing, and cost management.
• Experience with cloud infrastructure (AWS/Azure/GCP) and containerization.
• Experience administering SaaS or self-hosted developer platforms.
• Experience managing vendor or partner relationships, SLA tracking.

Responsibilities

• Administer and operate the AI Gateway and Agent Builder platforms for reliability and security.
• Act as SME for AI Gateway and Agent Builder; provide guidance and escalation.
• Educate internal teams; deliver workshops on tooling usage.
• Manage platform health, on-call rotations, incident response, root cause analysis.
• Coordinate updates, patches, and version upgrades with minimal disruption.
• Manage vendor relationships with LiteLLM, Langfuse, and Lyzr; coordinate contracts.
• Track bugs and feature requests; keep stakeholders informed.
• Monitor usage metrics, cost, and performance; surface insights.
• Stay current with LLM gateway tech, observability tooling, and agentic platforms.
• Collaborate with security, infra, and engineering to maintain compliance.

Skills

Platform engineering

DevOps

LLM gateway

AI observability

Low-code/no-code tools

Cloud (AWS/Azure/GCP)

SaaS platforms

Vendor management

Communication

Organizational skills

Education

Bachelor's degree in Computer Science or Engineering

Tools

LiteLLM

Langfuse

Lyzr AgentStudio

LangGraph

CrewAI

Docker

Kubernetes

AWS

Azure

GCP

Job description

EXL is seeking a seasoned Platform Engineer to operate and optimize our AI Gateway and Agent Builder platforms. You will serve as SME for AI tooling, lead enablement sessions, and ensure platform reliability across hybrid cloud environments.

Ideal candidates have 3–6 years in platform engineering or DevOps, hands-on experience with LLM gateways, and familiarity with low-code agent builders. Join a global data and AI leader delivering secure, scalable solutions.