AgentOps Engineer

XenonStack; Mohali; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

XenonStack is seeking an AgentOps Engineer in Mohali to deploy, monitor, and optimize agentic AI systems in production. You will work at the intersection of MLOps, DevOps, and Agentic AI to enable enterprises to adopt AI agents at scale, ensuring reliability and efficiency.

The role focuses on deploying multi-agent systems, integrating with enterprise APIs, and building observability and optimization pipelines to deliver measurable business outcomes.

Qualifications

• 2–5 years of experience in DevOps, MLOps, or AI systems engineering.
• Hands-on with LLM orchestration frameworks (LangChain, LangGraph, LlamaIndex).
• Familiarity with AgentOps tools (LangSmith, PromptLayer, Weights & Biases, Arize AI).
• Proficiency in Python and scripting for automation.
• Experience with cloud platforms (AWS, GCP, Azure) and containerization (Docker, Kubernetes).
• Knowledge of monitoring & observability tools (Prometheus, Grafana, ELK, OpenTelemetry).
• Understanding of RAG pipelines, vector databases, and context orchestration.

Responsibilities

• Deploy and maintain LLM-powered and multi-agent systems across cloud and on-prem environments.
• Integrate agents with enterprise APIs, knowledge bases, and third-party systems.
• Implement agentic observability frameworks to track performance, latency, cost, and accuracy.
• Monitor execution traces, context windows, and agent interactions for anomalies.
• Fine-tune agent configurations for cost efficiency, scalability, and response quality.
• Implement fallbacks, guardrails, and redundancy mechanisms to ensure reliability.
• Build automated pipelines to evaluate agent performance, safety, and compliance.
• Feed test results into continuous improvement loops with ML/AI engineers.
• Collaborate with Responsible AI teams to implement trust, safety, and audit mechanisms.

Skills

DevOps

MLOps

AI systems

Python

LLM orchestration

AgentOps tools

Monitoring

Tools

LangChain

LangGraph

LlamaIndex

LangSmith

PromptLayer

Weights & Biases

Arize AI

Job description

XenonStack is the fastest-growingData and AI Foundry for Agentic Systems, enabling people and organizations to gainreal-time and intelligent business insights.

Inference AI Infrastructure for Agentic Systems→nexastack.ai

Our mission is to accelerate the world’s transition toAI + Human Intelligenceby makingAI agents enterprise-ready, reliable, and production-grade.

THE OPPORTUNITY

We are seeking anAgentOps Engineertodeploy, monitor, and optimize agentic AI systems in production environments.

This role is at the core ofAI observability and operational reliability, ensuring that multi-agent workflows perform consistently, safely, and efficiently. You’ll work at the intersection ofMLOps, DevOps, and Agentic AI, enabling enterprises to confidently adopt AI agents at scale.

KEY RESPONSIBILITIES

Agent Deployment & Operations

Deploy and maintainLLM-powered and multi-agent systemsacross cloud and on-prem environments.

Integrate agents withenterprise APIs, knowledge bases, and third-party systems.

Monitoring & Observability

Implementagentic observability frameworksto track performance, latency, cost, and accuracy.

Monitorexecution traces, context windows, and agent interactionsfor anomalies.

Optimization & Reliability

Fine-tune agent configurations forcost efficiency, scalability, and response quality.

Implementfallbacks, guardrails, and redundancy mechanismsto ensure reliability.

Evaluation & Feedback Loops

Build automated pipelines to evaluateagent performance, safety, and compliance.

Feed test results intocontinuous improvement loopswith ML/AI engineers.

Security & Compliance

Ensure agents followenterprise security, governance, and compliance standards.

Collaborate with Responsible AI teams to implementtrust, safety, and audit mechanisms.

Cross-Functional Collaboration

Work withAI engineers, DevOps, and product managersto align operational reliability with business outcomes.

Support customer deployments withcustomized monitoring and tuning.

SKILLS & QUALIFICATIONS

Must-Have

2–5 years of experience inDevOps, MLOps, or AI systems engineering.

Hands-on withLLM orchestration frameworks(LangChain, LangGraph, LlamaIndex).

Familiarity withAgentOps tools(LangSmith, PromptLayer, Weights & Biases, Arize AI).

Proficiency inPythonand scripting for automation.

Experience withcloud platforms (AWS, GCP, Azure)and containerization (Docker, Kubernetes).

Knowledge ofmonitoring & observability tools(Prometheus, Grafana, ELK, OpenTelemetry).

Understanding ofRAG pipelines, vector databases, and context orchestration.

Good-to-Have

Experience inResponsible AI / model evaluation frameworks.

Familiarity withCI/CD pipelines for AI models and agents.

Background in BFSI, GRC, SOC, or enterprise SaaS systems.

WHY SHOULD YOU JOIN US?

Agentic AI Product Company

Work on next-gen AI platforms whereagent reliability and observabilitydefine enterprise adoption.

A Fast-Growing Category Leader

Join one of the fastest-growingAI Foundries, poweringmission-critical AI agentsfor global enterprises.

Career Mobility & Growth

Grow into roles such asAgentOps Lead, Reliability Engineer, or AI Systems Architect.

Global Exposure

Manageenterprise-scale AgentOps deploymentsacross regulated industries worldwide.

Create Real Impact

Ensure thatAI agents in production deliver measurable business outcomes.

Culture of Excellence

Our values —Agency, Taste, Ownership, Mastery, Impatience, and Customer Obsession— empower you to build, innovate, and own outcomes.

Responsible AI First

Contribute totrustworthy, explainable, and compliant AI agentsthat enterprises can rely on.

XENONSTACK CULTURE – JOIN US & MAKE AN IMPACT!

At XenonStack, we believe inshaping the future of intelligent systems. We foster aculture of cultivationbuilt on bold, human-centric leadership principles, wheredeep work, simplicity, and adoptiondefine everything we do.

Our Cultural Values

Agency– Be self-directed and proactive.

Taste– Sweat the details and build with precision.

Ownership– Take responsibility for outcomes.

Mastery– Commit to continuous learning and growth.

Impatience– Move fast and embrace progress.

Customer Obsession– Always put the customer first.

Our Product Philosophy

Obsessed with Adoption– Making AI agents reliable and enterprise-ready.

Obsessed with Simplicity– Turning complex agent operations into seamless, intuitive workflows.

Be a part of our mission toaccelerate the world’s transition to AI + Human Intelligence— by ensuringAI agents are reliable, secure, and production-ready.