LLM Operations Engineer

Accenture; Pune District; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Accenture in Pune is seeking an AI Engineer specializing in Generative AI and multi-agent systems to design and deploy LLM-powered autonomous solutions across enterprise systems.

You will build agent-driven architectures enabling systems to reason, collaborate, and execute complex workflows with cutting-edge agentic AI frameworks and memory mechanisms.

Qualifications

• 3+ years in AI/ML with Generative AI focus.
• Experience building multi-agent orchestration systems.
• Strong Python development and API integration experience.
• Familiarity with LLM evaluation frameworks and RAG pipelines.

Responsibilities

• Design and build multi-agent AI systems capable of planning, reasoning, and task execution
• Develop applications using LLMs with prompt engineering and orchestration
• Implement Agentic workflows (planner – executor – critic – memory loops)
• Build RAG pipelines with vector databases for enterprise grounding
• Develop tool-using agents that integrate with APIs, databases, and enterprise systems
• Architect and deploy AI copilots and autonomous assistants for business workflows
• Optimize LLM performance using fine-tuning, prompt chaining, and caching
• Implement memory mechanisms (vector stores, knowledge graphs)
• Design multi-agent collaboration protocols (hierarchical, swarm, role-based)
• Deploy scalable solutions using MLOps & LLMOps (monitoring, guardrails)
• Ensure AI safety, governance, and responsible AI practices

Skills

Python development

Generative AI

LLMs/GenAI frameworks

Agent frameworks

RAG pipelines

Vector databases

MLOps/LLMOps

Prompt engineering

Knowledge graphs

Team collaboration

Communication with stakeholders

Education

15 years full time education

Tools

Docker

Kubernetes

CI/CD

OpenAI API

Hugging Face Transformers

LangChain

AutoGen

CrewAI

Semantic Kernel

FAISS

Pinecone

Weaviate

Job description

Project Role

LLM Operations Engineer

Project Role Description

Utilize cloud-native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations.

Must have skills

Generative AI, Machine Learning Operations, Large Language Models (LLMs), Agentic AI

Good to have skills

NA

Experience

Minimum 3 year(s) of experience is required.

Educational Qualification

15 years full time education.

Summary

We are looking for a highly skilled AI Engineer specializing in Generative AI and Multi-Agent Systems to design and deploy intelligent, autonomous solutions. This role focuses on building LLM-powered, agent-driven architectures that can reason, collaborate, and execute complex workflows across enterprise systems.

You will work on cutting-edge Agentic AI frameworks, enabling systems that go beyond prediction to decision‑making, orchestration, and autonomous execution.

Roles & Responsibilities

• Design and build multi‑agent AI systems capable of planning, reasoning, and task execution
• Develop applications using LLMs (GPT, Claude, Llama, etc.) with advanced prompt engineering and orchestration
• Implement Agentic workflows (planner – executor – critic – memory loops)
• Build RAG (Retrieval-Augmented Generation) pipelines with vector databases for enterprise knowledge grounding
• Develop tool‑using agents that integrate with APIs, databases, and enterprise systems
• Architect and deploy AI copilots and autonomous assistants for business workflows
• Optimize LLM performance using fine‑tuning, prompt chaining, and caching strategies
• Implement short‑term and long‑term memory mechanisms (vector stores, knowledge graphs)
• Design multi‑agent collaboration protocols (hierarchical, swarm, role‑based agents)
• Deploy scalable solutions using MLOps & LLMOps practices (monitoring, evaluation, guardrails)
• Ensure AI safety, governance, and responsible AI practices

Professional & Technical Skills

• Experience building multi‑agent orchestration systems with role‑based coordination
• Exposure to agent planning algorithms (ReAct, Plan‑and‑Execute, Tree of Thought)
• Experience with LLM evaluation frameworks (RAGAS, TruLens, Promptfoo)
• Knowledge of graph‑based reasoning, knowledge graphs
• Building autonomous systems or copilots in enterprise environments
• Domain experience in industrial, energy, or IoT environments
• Systems thinking for designing autonomous AI architectures
• Strong problem decomposition for agent task design
• Ability to balance latency, cost, and accuracy in LLM systems
• Communication with business stakeholders to translate workflows into agent pipelines
• Innovation mindset with focus on applying agentic AI in production
• 3–8 years' experience in AI/ML with strong focus on Generative AI
• Strong Python development skills
• Hands‑on experience with:
  • LLMs & GenAI frameworks – OpenAI, Hugging Face Transformers
  • Agent frameworks – LangChain, AutoGen, CrewAI, Semantic Kernel
  • RAG pipelines & vector DBs – FAISS, Pinecone, Weaviate
  • Experience building API‑driven, tool‑integrated AI agents
• Strong understanding of:
  • Prompt engineering & prompt optimization
  • Chain‑of‑thought reasoning and tool augmentation
  • Context management and token optimization
• Experience with cloud platforms (Azure OpenAI preferred, AWS/GCP acceptable)
• Knowledge of Docker, Kubernetes, CI/CD pipelines

Additional Information

• The candidate should have minimum 3 years of experience in Generative AI.
• This position is based at our Pune office.

Important Notice

We have been alerted to the existence of fraudulent messages asking job seekers to set up payment to cover various costs associated with establishing employment at Accenture. No one is ever required to pay for employment at Accenture. If you are contacted by someone asking for payment, please do not respond, and contact us at [e-mail] immediately.

Equal Employment Opportunity Statement

All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

Recruiting and Hiring Statement

Please read Accenture's Recruiting and Hiring Statement for more information on how we process your data during the Recruiting and Hiring process.