Senior AI Engineer - Product Engineering

Avathon; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Avathon in Bengaluru, India invites an experienced Senior AI Engineer to architect and deploy GenAI and LLM-based systems across production pipelines. You will design end‑to‑end LLM workflows, RAG setups, and scalable APIs, collaborating with product and engineering teams.

The role demands strong Python, PyTorch, cloud familiarity (AWS/GCP/Azure), and a pragmatic, ownership‑driven mindset to deliver reliable AI capabilities at scale.

Qualifications

• Hands-on experience designing and deploying LLM-based applications in production environments.
• Strong Python and modern AI/ML frameworks experience.
• Experience with transformer architectures, fine-tuning, RAG, and vector databases.
• Experience building scalable APIs and backend systems for AI workflows.

Responsibilities

• Design, build, and deploy production-grade AI/ML systems focused on Generative AI and LLM-powered apps.
• Develop end-to-end LLM pipelines, including RAG, fine-tuning, prompt orchestration, evaluation, and observability.
• Build scalable backend services and APIs for AI applications.
• Implement transformer-based models and GenAI workflows for enterprise use cases.
• Design vector-search and embedding pipelines for knowledge-intensive apps.
• Collaborate with product, engineering, and business teams to translate challenges into AI solutions.
• Drive experimentation, benchmarking, model evaluation, and performance optimization.
• Improve inference efficiency, latency, cost, and reliability of deployed AI systems.
• Establish guardrails, monitoring, and responsible AI practices for production deployments.
• Contribute to MLOps workflows including CI/CD and model lifecycle management.
• Stay current with advancements in LLMs and applied AI engineering.

Skills

LLM engineering

Python

PyTorch

Transformer models

RAG systems

Cloud platforms

API development

MLOps

Stakeholder collaboration

Education

Bachelor's/Master's in CS/AI

Tools

LangChain

LlamaIndex

HuggingFace

Weights & Biases

Job description

Senior AI Engineer – Generative AI & LLMs

Location: Bangalore

Work Arrangement: Five days onsite.

Responsibilities

• Design, build, and deploy production‑grade AI/ML systems with a focus on Generative AI and LLM‑powered applications.
• Develop and optimize end‑to‑end LLM pipelines, including RAG architectures, fine‑tuning, prompt orchestration, evaluation, and observability.
• Build scalable backend services and APIs for AI applications using modern engineering best practices.
• Implement and productionise transformer‑based models and GenAI workflows for enterprise use cases.
• Design vector‑search systems, embedding pipelines, and retrieval frameworks for knowledge‑intensive applications.
• Partner closely with Product, Engineering, and Business teams to translate operational challenges into scalable AI solutions.
• Drive experimentation, benchmarking, model evaluation, and performance optimisation with scientific rigor.
• Improve inference efficiency, latency optimisation, cost management, and reliability of deployed AI systems.
• Establish guardrails, hallucination detection, monitoring, and responsible AI practices for production deployments.
• Contribute to MLOps workflows including CI/CD, model lifecycle management, observability, and cloud deployment.
• Stay current with the latest advancements in LLMs, agentic systems, foundation models, and applied AI engineering.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Machine Learning, Data Science, or a related technical field.
• 3–6 years of hands‑on industry experience in AI Engineering, Machine Learning Engineering, Applied AI, or related roles.
• Strong experience building and deploying LLM‑based applications in production environments.
• Solid expertise with Python and modern AI/ML frameworks such as PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, or similar.
• Strong understanding of transformer architectures, LLM fine‑tuning, prompt engineering, RAG systems, and vector databases.
• Experience building scalable APIs and backend systems supporting AI workflows.
• Familiarity with cloud platforms such as AWS, GCP, or Azure.
• Strong software engineering fundamentals including system design, debugging, performance optimisation, and production reliability.
• Experience with containerisation, deployment pipelines, and collaborative engineering environments.
• Strong analytical thinking, ownership mindset, and ability to work in ambiguous, fast‑moving startup environments.
• Strong communication skills and ability to work cross‑functionally with technical and business stakeholders.

Preferred Qualifications

• Exposure to Retrieval‑Augmented Generation (RAG), vector databases or embedding‑based search systems.
• Familiarity with LLM observability and evaluation tools such as Langfuse, LangSmith, Arize Phoenix, or Weights & Biases.
• Hands‑on experience with practical LLM deployment – prompt versioning, cost/latency tracking, guardrails, or hallucination detection.
• Exposure to LLM evaluation frameworks such as RAGAS or DeepEval or LLM‑as‑judge evaluation patterns.
• Basic understanding of MLOps practices and model lifecycle management.
• Experience working on applied AI projects in academic, internship, or startup settings.
• Interest in industrial AI and asset‑intensive environments.
• Industry exposure in one or more domains: Mining, Oil & Gas, Aerospace, Supply Chain, Logistics, or Renewable Energy.

Interview Process

As part of the interview process, you will be asked to complete a technical case study assessment. Expect at least two to three rounds of technical interviews and one onsite round.

Equal Opportunity Employer

Avathon is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, sexual orientation, gender identity, national origin, age, pregnancy, genetic information, disability, status as a protected veteran, or any other protected category under applicable federal, state, and local laws.

Avathon is committed to providing reasonable accommodations throughout the recruiting process. If you need a reasonable accommodation, please contact us to discuss how we can assist you.