LLM Operations Engineer

Accenture; Bengaluru; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

A global consulting firm is seeking an LLM Operations Engineer in Bengaluru. This role involves utilizing cloud-native services to ensure efficient deployment and performance monitoring of large language models. Applicants should hold 15 years of full-time education and demonstrate at least 3 years of experience with AI frameworks, particularly Generative and Agentic AI. Responsibilities include leading AI solution design to address business challenges and ensuring operational compliance and security in AI operations.

Qualifications

• 3+ years of experience is required in Large Language Models.
• Strong grasp of Generative and Agentic AI.
• Ability to align AI capabilities with business objectives.

Responsibilities

• Lead AI‑driven solution design and delivery.
• Apply GenAI to address complex business challenges.
• Integrate intelligent insights into enterprise workflows for measurable impact.

Skills

Large Language Models

Generative AI

Agentic AI

Prompt Engineering

AI Evaluation Frameworks

Education

15 years full‑time education

Job description

About The Role

Project Role: LLM Operations Engineer

Project Role Description: Utilize cloud‑native services and tools for scalable and efficient deployment. Monitor LLM performance, address operational challenges, and ensure compliance and security standards in AI operations.

Must Have Skills

• Large Language Models

Good to Have Skills

NA

Minimum Experience

3 year(s) of experience is required

Educational Qualification

15 years full‑time education

Summary

Seeking a forward‑thinking professional with an AI‑first mindset to design, develop, and deploy enterprise‑grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.

Roles & Responsibilities

Lead AI‑driven solution design and delivery by applying GenAI and Agentic AI to address complex business challenges, automate processes, and integrate intelligent insights into enterprise workflows for measurable impact.

Skills

• Strong grasp of Generative and Agentic AI, prompt engineering, and AI evaluation frameworks. Ability to align AI capabilities with business objectives while ensuring scalability, responsible use, and tangible value realization.
• The candidate should have minimum 3 years of experience in Large Language Models.

Additional Information

• This position is based at our Bengaluru office.
• A 15 years full‑time education is required.