AI Engineer (Agentic AI & LLM Systems)

Beroe Inc; Chennai District; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A leading technology firm in Chennai, Tamil Nadu is seeking an experienced AI Engineer to develop intelligent, agentic AI systems using cutting-edge large language models and multi-agent orchestration. You will be responsible for implementing robust RAG systems, collaborating with cross-functional teams, and integrating APIs into workflows. The ideal candidate has 7+ years of experience in machine learning, strong proficiency in Python, and a passion for innovative AI solutions. This position offers an exciting opportunity to work on groundbreaking technology in a dynamic environment.

Qualifications

• 7+ years of professional experience in machine learning, NLP, or software engineering.
• Strong proficiency in Python and experience with ML libraries like PyTorch, TensorFlow.
• Hands-on experience with LLMs and NLP tooling such as LangChain, HuggingFace.

Responsibilities

• Design and implement agentic AI pipelines using custom frameworks.
• Build robust retrieval-augmented generation (RAG) systems with vector databases.
• Fine-tune, evaluate, and deploy LLMs for task-specific applications.

Skills

Machine Learning

Natural Language Processing

Python

LLMs (GPT, Claude, etc.)

ML Libraries (PyTorch, TensorFlow)

Agent Frameworks

Microservice Architectures

Prompt Engineering

Tools

LangChain

FAISS

Docker

Terraform

Job description

Join to apply for the AI Engineer (Agentic AI & LLM Systems) role at Beroe Inc

We are looking for an experienced AI Engineer to join our growing AI team. You’ll play a key role in developing intelligent, agentic AI systems using cutting‑edge large language models (LLMs), multi‑agent orchestration, and retrieval‑augmented generation (RAG). This is a hands‑on role combining software engineering, ML/NLP expertise, and a passion for building next‑gen autonomous agents. You’ll collaborate closely with AI leads, backend engineers, data engineers, and product managers to bring scalable and intelligent systems to life—integrated into real‑world procurement and business applications.

Key Responsibilities

• Design and implement agentic AI pipelines using LangGraph, LangChain, CrewAI, or custom frameworks
• Build robust retrieval‑augmented generation (RAG) systems with vector databases (e.g., FAISS, Pinecone, OpenSearch)
• Fine‑tune, evaluate, and deploy LLMs for task‑specific applications
• Integrate external tools and APIs into multi‑agent workflows using dynamic tool/function calling (e.g., OpenAI JSON schema)
• Develop memory modules such as short‑term context, episodic memory, and long‑term vector stores
• Build scalable, cloud‑native services using Python, Docker, and Terraform
• Collaborate in agile, cross‑functional teams to rapidly prototype and ship ML‑based features
• Monitor and evaluate agent performance using tailored metrics (e.g., success rate, hallucination rate)
• Ensure secure, reliable, and maintainable deployment of AI systems in production environments

Your Profile

• 7+ years of professional experience in machine learning, NLP, or software engineering
• Strong proficiency in Python and experience with ML libraries like PyTorch, TensorFlow, scikit‑learn, and XGBoost
• Hands‑on experience with LLMs (e.g., GPT, Claude, LLaMA, Mistral) and NLP tooling such as LangChain, HuggingFace, and Transformers
• Experience designing and implementing RAG pipelines with chunking, semantic search, and reranking
• Familiarity with agent frameworks and orchestration techniques (e.g., planning, memory, role assignment)
• Deep understanding of prompt engineering, embeddings, and LLM architecture basics
• Design systems with role‑based communication, coordination loops, and hierarchical planning. Optimize agent collaboration strategies for real‑world tasks.
• Solid foundation in microservice architectures, CI/CD, and infrastructure‑as‑code (e.g., Terraform)
• Experience integrating REST/GraphQL APIs into ML workflows
• Strong collaboration and communication skills, with a builder’s mindset and willingness to explore new approaches

Bonus Qualifications

• Experience with RLHF, LoRA, or parameter‑efficient LLM fine‑tuning
• Familiarity with CrewAI, AutoGen, Swarm, or other multi‑agent libraries
• Exposure to cognitive architectures like task trees, state machines, or episodic memory
• Prompt debugging and LLM evaluation practices
• Awareness of AI security risks (e.g., prompt injection, data exposure)

Referrals increase your chances of interviewing at Beroe Inc by 2x.