Manager_AI Platform & Agent Ops

Tredence Inc.

Bengaluru

On-site

INR 400,000 - 700,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Tredence Inc. seeks a Platform & AgentOps Engineer to own the deployment, operations, and reliability of our AI platform across cloud and customer environments. This hands-on role focuses on Kubernetes platforms, automation, and enterprise-ready deployments with strong emphasis on security and observability.

You will design deployment architectures, drive CI/CD, GitOps, and incident response while collaborating with AI and Platform Engineering teams to scale and secure production workloads.

Qualifications

  • Hands-on platform engineering with production systems.
  • Strong Kubernetes expertise and cloud automation experience.
  • Experience with multi‑cloud or hybrid environments is a plus.

Responsibilities

  • Own deployment and operation architecture for AI platform components.
  • Build and operate Kubernetes-based platforms for large-scale workloads.
  • Lead cloud infra provisioning, release management, and platform reliability.
  • Establish CI/CD, GitOps, IaC, observability, security and DR standards.
  • Drive scalability planning, incident response, and capacity management.
  • Collaborate with AI teams to ensure cloud-native, secure enterprise deployments.
  • Support customer deployments across cloud, hybrid, and enterprise environments.

Skills

Platform engineering
Kubernetes
Cloud infrastructure
Observability & SRE
Security & compliance
Incident response

Tools

GKE
Cloud Run
BigQuery
Cloud Storage
Pub/Sub
IAM
VPC Networking
Cloud Monitoring
Secret Manager
Cloud Functions
API Gateway

Job description

We are building a next-generation Enterprise AI Platform powering AI Agents, Multi-Agent Systems, AI Workflows, RAG Applications, Knowledge Systems, and Enterprise Integrations. We are looking for a highly capable Platform & AgentOps Engineer to lead the deployment, operations, scalability, security, and reliability of our AI platform across cloud and customer environments.

This is a hands‑on engineering role for builders who enjoy owning production systems end‑to‑end. You will be responsible for designing deployment architectures, operating Kubernetes platforms, automating cloud infrastructure, establishing operational excellence, and ensuring that AI applications can be deployed, monitored, governed, and scaled reliably in enterprise environments.

Key Responsibilities
  • Own the deployment and operational architecture for AI Agents, Agent Servers, Workflow Engines, RAG Platforms, Model Gateways, and AI Runtime Services.
  • Design, build, and operate Kubernetes-based platforms supporting large-scale AI workloads.
  • Lead cloud infrastructure engineering, environment provisioning, deployment automation, release management, and platform reliability initiatives.
  • Establish CI/CD, GitOps, Infrastructure-as-Code, observability, security, disaster recovery, and operational standards across the platform.
  • Drive production readiness reviews, scalability planning, performance optimization, capacity management, and incident response processes.
  • Work closely with AI and Platform Engineering teams to ensure applications are cloud-native, secure, observable, and enterprise-ready.
  • Support customer deployments across cloud, hybrid-cloud, and enterprise-managed environments.
Mandatory Skills & Experience
  • Strong hands-on Google Cloud Platform (GCP) experience is mandatory.
  • Deep expertise with services such as GKE, Cloud Run, BigQuery, Cloud Storage, Pub/Sub, IAM, VPC Networking, Cloud Monitoring, Secret Manager, Cloud Functions, and API Gateway.
  • Strong experience with Azure and/or AWS is highly desirable.
  • Experience designing and operating secure, scalable, multi‑environment cloud architectures.
  • Deep production experience with Kubernetes (GKE preferred).
  • Strong expertise in Docker, Helm, Ingress Controllers, Autoscaling, Stateful Workloads, Service Discovery, Networking, Storage, and Secrets Management.
  • Experience operating multi‑cluster and multi‑environment Kubernetes deployments.
  • Strong troubleshooting capabilities across Kubernetes, networking, infrastructure, and application layers.
Infrastructure as Code & Deployment Automation
  • Strong Terraform expertise is mandatory.
  • Experience building reusable infrastructure modules and enterprise‑scale Infrastructure-as‑Code frameworks.
  • Hands‑on experience with GitHub Actions, GitLab CI/CD, Azure DevOps, ArgoCD, FluxCD, and GitOps deployment models.
  • Experience implementing automated provisioning, release automation, environment management, and deployment governance.
AgentOps & AI Infrastructure
  • Experience deploying and operating AI applications in production.
  • Understanding of Agent Servers, AI Workflow Engines, Model Gateways, RAG Services, Vector Databases, AI Runtime Infrastructure, and LLM-based applications.
  • Experience supporting OpenAI, Azure OpenAI, Claude, Gemini, Ollama, vLLM, TGI, or similar AI serving environments.
  • Understanding of AI workload scaling, model routing, latency optimization, throughput planning, token consumption monitoring, and operational governance.
Observability, Reliability & Operations
  • Strong experience with OpenTelemetry, Prometheus, Grafana, ELK, Datadog, Cloud Monitoring, or Application Insights.
  • Deep understanding of monitoring, distributed tracing, logging, ing, SRE practices, reliability engineering, and operational excellence.
  • Experience leading incident management, root‑cause analysis, disaster recovery planning, backup strategies, and production support.
Distributed Systems & Messaging
  • Strong experience with Redis, Redis Pub/Sub, Redis Streams, Kafka, RabbitMQ, Google Pub/Sub, Azure Service Bus, or AWS SQS/SNS.
  • Understanding of event‑driven architectures, distributed systems, fault tolerance, high availability, and scalability patterns.
Security & Enterprise Deployments
  • Experience implementing RBAC, IAM, SSO, SAML, OIDC, Secret Management, Network Security, Compliance Controls, and Secure Software Delivery practices.
  • Experience deploying applications into enterprise, regulated, and customer‑managed environments.
Highly Desirable
  • MCP (Model Context Protocol) infrastructure and integrations.
  • Self‑hosted LLM platforms using vLLM, Ray Serve, Ollama, TGI, or Kubernetes‑based inference infrastructure.
  • Vector databases such as Pinecone, Qdrant, Weaviate, Chroma, pgvector, and Vertex AI Search.
  • Service Mesh technologies including Istio and Linkerd.
  • Airflow, Temporal, Dagster, Prefect, or workflow orchestration platforms.
  • Platform Engineering, Internal Developer Platforms (IDP), Developer Experience tooling, and FinOps.
Who We Are Looking For
  • Engineers who can independently own mission‑critical production platforms.
  • Individuals with strong architectural thinking and exceptional troubleshooting abilities.
  • Builders who thrive in fast‑moving environments and enjoy solving infrastructure, reliability, scalability, and deployment challenges.
  • Professionals capable of evolving into Platform Leads, Cloud Architects, or Infrastructure Architects.

This is not a traditional DevOps role. We are looking for a Platform Engineer who can own the operational backbone of an enterprise AI platform, establish deployment excellence, and build the foundation on which large‑scale Agentic AI systems run reliably in production.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer - AI Platform
Staff Engineer - AI Platform

Highlevel Llc • New Delhi

On-site
INR 4,500,000 - 7,500,000
Engineering Lead-AI Agentic Platform
Engineering Lead-AI Agentic Platform

Aionos • Hyderabad

On-site
INR 3,500,000 - 7,000,000
Senior AI / Agentic Architect
Senior AI / Agentic Architect

Comviva • Bengaluru

On-site
INR 4,000,000 - 6,000,000
AI Solutions and Platforms Operations Engineer
AI Solutions and Platforms Operations Engineer

PepsiCo Inc. • Hyderabad

On-site
INR 1,000,000 - 2,000,000
Senior Agentic AI Platform Engineer – MCP & Agent Runtime
Senior Agentic AI Platform Engineer – MCP & Agent Runtime

ITOrizon • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Lead Platform Engineer
Lead Platform Engineer

EPAM Systems Inc • Bengaluru

On-site
INR 1,800,000 - 2,400,000
AI DevOps Engineer
AI DevOps Engineer

Anthrobyte • Hyderabad

On-site
INR 4,000,000 - 6,000,000
GPU compute resources
Premium cloud credits
Founding platform ownership
+1
Senior AI Engineer
Senior AI Engineer

Tredence • Bengaluru

On-site
INR 1,800,000 - 3,000,000
Senior Software Engineer - AI Platform Engineer
Senior Software Engineer - AI Platform Engineer

CloudBees • Chennai District

Hybrid
INR 3,500,000 - 5,500,000
AI Platforms Engineer
AI Platforms Engineer

PepsiCo Inc. • Hyderabad

On-site
INR 900,000 - 1,400,000