4423251-Manager

EXL; Dadri; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A consulting firm in Dadri is seeking a Mid-Senior LLM Engineer to lead a team of engineers and oversee the development of agent-based systems. The successful candidate will have deep knowledge of LLM workflows, strong backend skills, and proven experience with cloud platforms like AWS and Azure. This full-time role offers general shifts from 1:30 PM to 11:30 PM IST with potential for extended hours.

Qualifications

• Experience with databases like MongoDB, PostgreSQL, or MySQL.
• Track record of delivering LLM applications into production environments.

Responsibilities

• Lead and mentor a team of LLM engineers and AI developers.
• Architect and oversee the development of agent-based systems.
• Collaborate with product managers and data scientists.

Skills

Deep knowledge of agent orchestration

Proven experience in fine-tuning LLMs with CUDA-based optimizations

Strong backend skills with FastAPI

Hands-on experience with cloud platforms

Tools

Docker

AWS

Azure

GCP

Job description

Overview

Lead and mentor a team of LLM engineers and AI developers. Architect and oversee the development of agent-based systems using LangGraph, LangChain, AutoGen, or similar frameworks. Guide the design and deployment of scalable, production-grade LLM applications. Ensure best practices for fine-tuning, prompt engineering, and hybrid LLM usage. Oversee deployment on AWS/Azure with high performance and fault tolerance. Collaborate cross-functionally with product managers, data scientists, and DevOps.

Responsibilities

• Lead and mentor a team of LLM engineers and AI developers.
• Architect and oversee the development of agent-based systems using LangGraph, LangChain, AutoGen, or similar frameworks.
• Guide the design and deployment of scalable, production-grade LLM applications.
• Ensure best practices for fine-tuning, prompt engineering, and hybrid LLM usage.
• Oversee deployment on AWS/Azure with high performance and fault tolerance.
• Collaborate cross-functionally with product managers, data scientists, and DevOps.

Requirements

• Deep knowledge of agent orchestration, task decomposition, and memory/tool usage in LLM workflows.
• Proven experience in fine-tuning LLMs with CUDA-based optimizations.
• Strong backend skills with FastAPI, Docker, and cloud deployment (AWS EC2, Lambda, AKS, etc.).
• Track record of delivering LLM applications into production environments.
• Experience with databases like MongoDB, PostgreSQL, or MySQL.
• Hands-on experience with at least one cloud platform: AWS, Azure, or GCP.

Nice to Have

• Experience integrating async workflows (Celery, Ray) and event-driven architectures.
• Familiarity with LangServe, Haystack, and vector store orchestration.
• Open-source contributions or publications in LLM agent systems.
• Experience leading code reviews, architectural discussions, and sprint planning.

Soft Skills

• Strong communication skills — both verbal and written.
• Excellent problem-solving and debugging skills.
• Self-motivated with the ability to work independently and in a team.
• Comfortable working with stakeholders across different time zones.

Working Hours

General Shift: 1:30 PM to 11:30 PM IST. Flexibility to extend hours based on critical deployments or support needs.

Position details

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Other
• Industries: Business Consulting and Services

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.