LLMOps Engineer

Aventra.AI

Bengaluru

On-site

INR 1,800,000 - 3,200,000

Full time

8 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Aventra.AI in Bengaluru is seeking an experienced LLMOps Engineer to lead the design, deployment and optimization of enterprise-grade GenAI infrastructure. You will build reliable, scalable LLM applications and drive performance and cost efficiency across production environments.

You will design end-to-end LLMOps pipelines, manage model lifecycles, and collaborate with AI/ML/Data/DevOps teams to scale production AI across cloud platforms. Strong Python, Docker and Kubernetes are required.

Qualifications

  • 4+ years in AI, GenAI, LLMs
  • Hands-on with RAG architectures
  • Experience deploying production AI apps
  • Strong Python skills

Responsibilities

  • Design end-to-end LLMOps pipelines for enterprise GenAI apps.
  • Deploy, manage and monitor LLMs across AWS, Azure or GCP.
  • Build and optimize RAG pipelines: ingestion, embeddings, retrieval and reranking.
  • Implement model evaluation frameworks for accuracy, relevance, faithfulness and quality.
  • Develop automated CI/CD pipelines for LLM apps, prompts, models and workflows.
  • Implement LLM monitoring, tracing, logging and observability.
  • Optimize inference latency, token consumption, throughput and costs.
  • Work with vector databases and scalable AI services using Python and microservices.

Skills

Python programming
LLMs & Generative AI
MLOps practices
Production AI infra
OpenAI/Azure OpenAI/Claude/Gemini
RAG pipelines

Tools

Docker
Kubernetes
CI/CD
LangChain
LangGraph
Pinecone
FAISS
ChromaDB
Weaviate
Milvus

Job description

Relevant Experience: Minimum 4+ Years in AI

Work Mode: To be confirmed

Job Overview

We are looking for an experienced LLMOps Engineer with strong expertise in Generative AI, Large Language Models (LLMs), RAG pipelines and production AI infrastructure.

The ideal candidate should have hands-on experience building, deploying, monitoring, evaluating and optimizing enterprise-grade LLM applications. The candidate will be responsible for establishing scalable LLMOps practices, managing model lifecycle operations and ensuring reliability, performance, security and cost efficiency of AI-powered applications.

Key Responsibilities
  • Design, develop and implement end-to-end LLMOps pipelines for enterprise GenAI applications.
  • Deploy, manage and monitor LLMs across AWS, Azure or GCP environments.
  • Build and optimize RAG pipelines, including document ingestion, chunking, embeddings, retrieval and reranking.
  • Implement model evaluation frameworks to measure accuracy, relevance, faithfulness, hallucination and response quality.
  • Develop automated CI/CD pipelines for LLM applications, prompts, models and AI workflows.
  • Implement LLM monitoring, tracing, logging and observability.
  • Optimize inference latency, token consumption, throughput and model deployment costs.
  • Implement model versioning, prompt versioning and evaluation benchmarks.
  • Work with vector databases such as Pinecone, FAISS, ChromaDB, Weaviate or Milvus.
  • Build scalable AI services using Python, FastAPI and microservices architecture.
  • Implement model serving, API gateways, caching and load balancing.
  • Collaborate with AI Engineers, ML Engineers, Data Engineers and DevOps teams.
  • Establish production monitoring, incident management and continuous improvement processes.
Mandatory Technical Skills
  • Strong Python programming and software engineering experience.
  • Minimum 4+ years of hands-on experience in AI, Generative AI, LLMs and RAG.
  • Strong understanding of LLMOps and MLOps practices.
  • Experience with OpenAI, Azure OpenAI, Claude, Gemini or open-source LLMs.
  • Hands‑on experience with RAG architecture and implementation.
  • Experience with LangChain, LangGraph or similar frameworks.
  • Knowledge of embeddings, semantic search and vector databases.
  • Experience with LLM evaluation frameworks such as RAGAS, DeepEval, TruLens or LangSmith.
  • Experience with model monitoring, tracing and observability.
  • Strong experience with Docker, Kubernetes and CI/CD.
  • Cloud experience with AWS, Azure or GCP.
  • Experience deploying and managing production‑grade AI applications.
Good to Have
  • Experience with vLLM, Hugging Face, Ollama or NVIDIA Triton.
  • Knowledge of model quantization and inference optimization.
  • Experience with MLflow, Kubeflow or KServe.
  • Knowledge of LLM-as-a-Judge and automated AI evaluation.
  • Experience with MCP and Agentic AI systems.
  • Knowledge of GPU infrastructure and distributed inference.
Candidate Expectations
  • Ability to design scalable and reliable AI infrastructure.
  • Strong troubleshooting, optimization and performance engineering skills.
  • Experience managing AI applications throughout their production lifecycle.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML &LLMOps Engineer - 300426-66
ML &LLMOps Engineer - 300426-66

Sage IT, Inc. • Hyderabad, Bengaluru, Chennai

Remote
INR 1,200,000 - 1,800,000
MLOps / AI Engineer
MLOps / AI Engineer

VMC Soft Technologies • Hyderabad

On-site
INR 2,000,000 - 4,200,000
Ai Ml Engineer
Ai Ml Engineer

Agilisium • Pune District

On-site
INR 3,000,000 - 6,000,000
DevOps/MLOps Specialist
DevOps/MLOps Specialist

Bosch • Bengaluru

On-site
INR 3,500,000 - 7,000,000
AI / ML Ops Engineer
AI / ML Ops Engineer

Fyerx • India

On-site
INR 1,800,000 - 2,800,000
MLOps Engineer / Developer
MLOps Engineer / Developer

SASS INNOVATIONS • Bengaluru

On-site
INR 3,000,000 - 5,500,000
Senior Artificial Intelligence Engineer
Senior Artificial Intelligence Engineer

pepcus software services • Indore District, Pune District

On-site
INR 4,000,000 - 7,000,000
Senior Software Engineer (AI)
Senior Software Engineer (AI)

Dash Technologies INC • Ahmedabad

On-site
INR 2,500,000 - 4,500,000
AI/ML Engineer
AI/ML Engineer

Relanto • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Senior Consultant - MLOps
Senior Consultant - MLOps

SiriusAI • Gurugram District

On-site
INR 1,200,000 - 2,400,000