Machine Learning Engineer

Deccan AI; Hyderabad; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Deccan AI, Hyderabad-based AI infrastructure company, seeks a hands-on ML/AI engineer with 2–4 years of experience. You will build LLM and RAG systems, develop scalable ML/MLOps pipelines, and work across embeddings, vector databases, and agent frameworks using Python.

Collaboration with ML, research and engineering teams will drive prototypes to production. The role focuses on LLM/GenAI, RAG, Agentic AI and MLOps; computer vision/ multimodal experience is not required.

Qualifications

• 2–4 years hands-on ML/AI engineering experience.
• Strong Python and software engineering fundamentals.
• Experience with RAG, Agentic AI, MLOps, LLM applications or ML infrastructure.

Responsibilities

• Build and productionize LLM, RAG and Agentic AI systems.
• Develop scalable ML/MLOps pipelines for deployment, evaluation and monitoring.
• Work with LLMs, vector databases, embeddings, retrieval, reranking and agent frameworks.
• Build and optimize AI services using Python and modern ML/engineering tools.
• Collaborate with ML, research and engineering teams to take AI systems from prototype to production.

Skills

Python

ML/AI engineering

Problem-solving

Tools

LangChain/LangGraph

vector DBs

Docker/Kubernetes

MLflow/W&B

Job description

Job Description:

Location: Hyderabad | Work Mode: Onsite

Deccan AI is a Bay Area–headquartered AI infrastructure company, backed by Prosus Ventures, with $25M in Series A funding. We’re building the infrastructure and expert systems powering the next generation of AI.

What You'll Do

• Build and productionize LLM, RAG and Agentic AI systems.


• Develop scalable ML/MLOps pipelines for deployment, evaluation and monitoring.


• Work with LLMs, vector databases, embeddings, retrieval, reranking and agent frameworks.


• Build and optimize AI services using Python and modern ML/engineering tools.


• Collaborate with ML, research and engineering teams to take AI systems from prototype to production.

What We're Looking For

• 2–4 years of hands-on ML/AI engineering experience.


• Strong Python and software engineering fundamentals.


• Experience with RAG, Agentic AI, MLOps, LLM applications or ML infrastructure.


• Exposure to tools such as LangChain/LangGraph, vector DBs, Docker/Kubernetes, MLflow/W&B or similar.


• Strong problem-solving mindset and ownership.

Good to have: LLM evaluation, fine-tuning (SFT/LoRA/QLoRA/DPO), vLLM or model serving experience.

• Note: This role is focused on LLM/GenAI, RAG, Agentic AI and MLOps — Computer Vision / Multimodal experience is not required.

Interview Process

Recruiter Discussion

Assessment of background, experience, and motivation

Technical Project Deep Dive

Detailed walkthrough of a complex ML project with focus on technical ownership and implementation depth

Technical Evaluation

Coding assessment, ML systems design discussion, and practical implementation evaluation focused on LLMs and ML engineering

Culture & Team Fit

Evaluation of communication, collaboration, ownership mindset, and alignment with Deccan AI’s operating culture