Software Engineer AI (Lead/ Manager/ Principal)

Naukri E-hire; Hyderabad; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Naukri E-hire is seeking an experienced senior AI/ML engineer to design and build AI-enabled applications, focusing on scalable backend systems, distributed architectures, and production-grade RAG pipelines. The role emphasizes hands-on development with Java and Python, integration of LLMs, and cloud deployments.

Ideal candidates will have 5+ years in software engineering and 3+ years in AI/LLM projects, with expertise in REST APIs, containerization (Docker, Kubernetes), and modern DevOps

Qualifications

• BS or MS in CS, AI, ML, or related field.
• 5+ years of software engineering experience.
• At least 3 years building AI/Generative AI applications using LLMs.
• 3 years backend development and distributed systems.
• Proficiency in Java and Python.
• Hands-on experience with AI orchestration frameworks such as LangGraph, LangChain, LlamaIndex, etc.
• Experience designing and implementing production-grade RAG systems, including embedding models, semantic search, hybrid search, reranking, and vector databases.
• Experience with vector databases such as Milvus, Pinecone, Weaviate, OpenSearch, Elasticsearch, FAISS, or ChromaDB.
• Experience integrating and deploying applications using LLMs such as OpenAI GPT, Claude, Gemini, Llama, Mistral, Amazon Nova, or Azure OpenAI.
• Strong experience building REST APIs using FastAPI or similar Python frameworks.
• Experience with containerization and orchestration technologies such as Docker and Kubernetes.
• Experience deploying AI solutions on cloud platforms such as AWS, Azure, or GCP.
• Familiarity with CI/CD pipelines, Git, and modern DevOps practices.
• Experience with AI evaluation, prompt engineering, observability, and monitoring tools such as LangSmith, Langfuse, MLflow, OpenTelemetry, Prometheus, or Grafana.
• Strong understanding of software architecture, microservices, asynchronous programming, and distributed systems.
• Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in a cross-functional team environment.

Skills

Software engineering

AI/LLM experience

Java

Python

LLM orchestration

RAG systems

Distributed systems

Cloud platforms

CI/CD & Git

Observability & monitoring

Software architecture

Education

Bachelor's or Master's degree in CS/AI/ML or related field

Tools

LangGraph

LangChain

LlamaIndex

Milvus

Pinecone

Weaviate

OpenSearch

Elasticsearch

FAISS

ChromaDB

OpenAI GPT

Claude

Gemini

Llama

Mistral

Amazon Nova

Azure OpenAI

FastAPI

Docker

Kubernetes

AWS

Azure

GCP

LangSmith

Langfuse

MLflow

OpenTelemetry

Prometheus

Grafana

Git

Job description

Required Qualifications:

• Bachelor's or master’s degree in computer science, Artificial Intelligence, Machine Learning, or a related technical field.
• 5+ years of overall software engineering experience.
• Minimum 3 years of hands‑on experience building AI/Generative AI applications using Large Language Models (LLMs).
• Minimum 3 years of experience developing scalable backend software and distributed systems.
• Strong proficiency in Java and Python and modern software engineering principles.
• Hands‑on experience with AI orchestration frameworks such as LangGraph, LangChain, LlamaIndex, etc.
• Experience designing and implementing production‑grade RAGsystems, including embedding models, semantic search, hybrid search, reranking, and vector databases.
• Experience with vector databases such as Milvus, Pinecone, Weaviate, OpenSearch, Elasticsearch, FAISS, or ChromaDB.
• Experience integrating and deploying applications using LLMs such as OpenAI GPT, Claude, Gemini, Llama, Mistral, Amazon Nova, or Azure OpenAI.
• Strong experience building REST APIs using FastAPIor similar Python frameworks.
• Experience with containerization and orchestration technologies such as Dockerand Kubernetes.
• Experience deploying AI solutions on cloud platforms such as AWS, Azure, or GCP.
• Familiarity with CI/CD pipelines, Git, and modern DevOps practices.
• Experience with AI evaluation, prompt engineering, observability, and monitoring tools such as LangSmith, Langfuse, MLflow, OpenTelemetry, Prometheus, or Grafana.
• Strong understanding of software architecture, microservices, asynchronous programming, and distributed systems.
• Excellent problem-solving, communication, and collaboration skills, with the ability to work effectively in a cross‑functional team environment.