GCP Agent OPS Engineer

Deloitte Shared Services India

New Delhi, Pune District, Mumbai

Hybrid

INR 2.400.000 - 2.800.000

Vollzeit

Vor 6 Tagen
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Deloitte Shared Services India in New Delhi is seeking an Agent Ops Engineer with 8-12 years of experience to design and operate agentic deployment and LLMOps workflows.

The role focuses on GCP infrastructure, secure IAM, SDLC automation, and containerized deployments using Cloud Run, GKE, Terraform, and GitHub Actions.

You will work on latency optimization, packaging ADK-based apps, and integrating vector stores for scalable AI workloads.

Qualifikationen

  • Experience deploying agentic apps on GCP using Google ADK or Vertex AI Agents.
  • Strong understanding of LLM Ops concepts, prompts, tools, and embeddings.

Aufgaben

  • Design and implement deployment strategies for Google ADK and GenAI agent workflows.
  • Establish LLMOps pipelines for versioning, prompt registry, and runtime config.
  • Orchestrate runtimes, vector stores, and memory with scale-to-zero compute (Cloud Run, GKE).
  • Optimize latency and costs of hosting agentic architectures.

Kenntnisse

Agentic deployment
LLMOps concepts
GCP infrastructure
SDLC / DevOps

Tools

Google ADK / Vertex AI Agent Builder
GitHub Actions
Terraform
Docker
Cloud Run
GKE
BigQuery
VPC Networking
IAM

Jobbeschreibung

AGENT OPS ENGINEER


Location: India
Experience: 8-12 Years


Key Responsibilities
1. Agentic Application Deployment & LLMOps
  • Design and implement deployment strategies specifically for Google ADK (Agent Development Kit) and GenAI agentic workflows.
  • Establish LLMOps/FMOps pipelines to handle agent versioning, prompt registry management, and runtime configuration.
  • Orchestrate agent runtimes, vector database integrations, and memory stores on scale-to-zero compute systems like Cloud Run or orchestration layers like GKE.
  • Optimize latency, cold-start times, and compute costs associated with hosting agentic architectures.
2. GCP Cloud Infrastructure & Networking
  • Configure and maintain high-performance, secure compute environments using GKE and Cloud Run optimized for AI workloads.
  • Design secure VPC Networking topologies to support agent communication with internal APIs, external tools, databases, and Google Gemini models.
  • Optimize BigQuery infrastructure for storing, indexing, and querying structured data or agent execution logs/telemetry.
3. Security, Guardrails, and IAM
  • Implement strict GCP IAM policies to manage access controls for LLM APIs, agent tools, and data stores.
  • Secure agent runtime environments using VPC Service Controls, Private Service Connect, and workload identity federation.
  • Establish guardrails to monitor and secure egress calls made by autonomous agents.
4. SDLC Automation & GitHub Pipelines
  • Build robust GitHub Actions pipelines designed for Agentic SDLCs, including automated testing of agent tools, prompt evaluations (evals), and deployment of agent manifests.
  • Automate the packaging (Docker containerization) and deployment of ADK-based applications to GCP Artifact Registry.
  • Implement automated rollback and canary deployment strategies for live agentic applications.
Required Technical Skills and Qualifications
AI/Agentic Deployment Domain:
  • Google ADK / Vertex AI Agent Builder: Direct experience deploying, scaling, and managing agentic applications built using Googles Agent Development Kit, Vertex AI Agents, or Dialogflow CX.
  • LLMOps Concepts: Understanding of prompt tracking, agent tool integration, embeddings, and vector search deployment on GCP.
Core GCP Infrastructure:
  • Containers & Serverless: Deep expertise in Cloud Run and GKE (with experience hosting AI middleware, API gateways, or agent runtimes).
  • Data & Storage: Solid understanding of BigQuery and vector database integrations (e.g., Vertex AI Vector Search, pgvector, etc.).
  • Networking: Practical knowledge of VPCs, Private Google Access, Load Balancing, and Secure API gateways.
  • Security: Mastery of GCP IAM, Secret Manager, and service-to-service authentication.
DevOps & SDLC Tools:
  • CI/CD: Advanced automation experience with GitHub Actions for complex, multi-stage deployment workflows.
  • IaC: Hands-on experience writing Terraform configurations to provision resources for GenAI applications.
  • Containerization: Mastery of Docker, container optimizations, and secure artifact storage.
Preferred Qualifications
  • Experience setting up continuous evaluation (GenAI Evals) pipelines within CI/CD.
  • Google Cloud Certified Professional Cloud DevOps Engineer or Professional Machine Learning Engineer certification.
  • Familiarity with Python-based agentic frameworks (e.g., LangChain, LangGraph,) and how they compile/deploy into the Google ADK ecosystem.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Principal GenAI & Agentic AI Engineer
Principal GenAI & Agentic AI Engineer

Sabre • Bengaluru

Hybrid
INR 4.000.000 - 7.000.000
Lead Systems Engineer - Google Forward Deployed Engineer
Lead Systems Engineer - Google Forward Deployed Engineer

EPAM Systems Inc • Pune District, Gurugram District, Coimbatore

Vor Ort
INR 3.000.000 - 6.000.000
Lead Forward Deployed Engineer - GCP
Lead Forward Deployed Engineer - GCP

EPAM Systems Inc • Pune District, Gurugram District, Coimbatore

Vor Ort
INR 3.000.000 - 7.000.000
We're Hiring | AI Platform Engineer | Build What's Next in AI | Noida (Hybrid)
We're Hiring | AI Platform Engineer | Build What's Next in AI | Noida (Hybrid)

Cloudsufi • Noida

Vor Ort
INR 4.000.000 - 6.000.000
GCP - Agentic AI Engineer
GCP - Agentic AI Engineer

KPI Partners • Bengaluru

Vor Ort
INR 1.500.000 - 2.000.000
Lead Administrator (Support &Operations)
Lead Administrator (Support &Operations)

HCL Technologies Limited • Uttar Pradesh

Vor Ort
INR 900.000 - 1.300.000
Principal GenAI & Agentic AI Engineer
Principal GenAI & Agentic AI Engineer

Aimlroles • Bengaluru

Vor Ort
INR 4.000.000 - 6.000.000
Lead Forward Deployed Engineer - GCP
Lead Forward Deployed Engineer - GCP

EPAM Systems • Indien

Vor Ort
INR 2.500.000 - 5.000.000
GCP Cloud Platform Engineer / AI Cloud DevOps Architect
GCP Cloud Platform Engineer / AI Cloud DevOps Architect

Expleo Group • Chennai

Vor Ort
INR 1.800.000 - 3.000.000
Technical Lead Agentic Ai With Gcp Capgemini Pune Bengaluru Delhi Ncr
Technical Lead Agentic Ai With Gcp Capgemini Pune Bengaluru Delhi Ncr

Vibehackers • Pune District, Bengaluru

Hybrid
INR 2.500.000 - 5.000.000