Senior Software Engineer - AI

Truveta; Hyderabad; On-site; INR 2,500,000 - 3,500,000; Full time

Job summary

Truveta is seeking AI engineers to join the Intelligence Platform and Applications team in Hyderabad. You will build scalable, self-improving AI agents and foundation models that reason, learn, and drive data-driven healthcare insights.

You’ll blend ML craftsmanship with platform engineering, optimize RAG pipelines, and work across research, care delivery, and operations to impact researchers, clinicians, and patients.

Qualifications

• BS/MS in CS, AI, or related field.
• 5+ years building scalable ML systems in a team
• Strong Python and cloud engineering fundamentals
• Experience with agentic AI frameworks (LangGraph, AutoGen, CrewAI) and MCP
• Experience with vector databases and RAG pipelines
• Hands-on fine-tuning of LLMs or multimodal models (LoRA, PEFT, TRL)
• Strong communication and teamwork skills

Responsibilities

• Build scalable, self-improving AI agents and models for healthcare applications.
• Collaborate with platform, application, and product teams to translate concepts into robust systems.
• Design and optimize retrieval-augmented generation pipelines and semantic search workflows.
• Contribute to responsible AI practices and ethical considerations in healthcare intelligence.

Skills

Agentic AI frameworks

ML validation & evaluation

Python programming

Cloud platforms

Vector databases and embeddings

Model fine‑tuning

Team collaboration

Education

B.S./M.S. in Computer Science or AI

Tools

LangGraph

AutoGen

CrewAI

FAISS

Pinecone

Chroma

Azure AI Search

Docker

Kubernetes

FastAPI

Job description

Truveta is the world’s first health provider led data platform with a vision of Saving Lives with Data. Our mission is to enable researchers to find cures faster, empower every clinician to be an expert, and help families make the most informed decisions about their care. Achieving Truveta’s ambitious vision requires an incredible team of talented and inspired people with a special combination of health, software and big data experience who share our company values.

This position is based out of our India Development Center in Hyderabad.

Who we are looking for

Join Truveta’s Intelligence Platform and Applications (IPA) team to build the next wave of healthcare AI — developing adaptive agentic systems and fine-tuned foundation models that continuously learn, reason, and accelerate real-world impact. Guided by Truveta’s mission of Saving Lives with Data, you’ll help transform how health data becomes intelligence, powering breakthroughs that enable researchers, clinicians and operational managers to make data-driven, proactive, and impactful decisions. We firmly believe that patients, doctors, and medical researchers deserve to benefit from the artificial intelligence revolution that is transforming productivity, creativity, and communication. You’ll help shape the AI capabilities that make healthcare more intelligent, efficient, and equitable — driving real-world impact across research, care delivery, and patient outcomes. If you’re seeking a sense of purpose and are motivated to advance how AI supports learning, decision-making, and discovery in healthcare, you’ll find this an inspiring place to grow.

We are seeking AI Engineers who thrive at the intersection of agentic and applied AI, machine learning, and large‑scale engineering. You’ll blend ML craftsmanship with platform engineering excellence to create scalable, self‑improving AI agents and models that learn from vast, diverse healthcare data and deliver meaningful insights through automation and reasoning. As part of the IPA team, you’ll use your expertise in applied AI, model optimization, and agentic intelligence to create systems that think, adapt, and improve R&D, business strategy, operations and care delivery across the healthcare ecosystem. You’ll work in an ambitious, fast‑paced and collaborative environment where every contribution helps make healthcare more connected, intelligent, and impactful.

Required skills

Agentic AI

• Design and reason with agentic AI frameworks — experienced in building multi‑agent workflows using frameworks such as LangGraph, AutoGen, or CrewAI, integrating reasoning, reflection, planning, tool use and memory to create intelligent, goal‑driven systems. Have a deep understanding of capabilities of multi‑modal models in agentic systems.
• Understand evaluation deeply — fluent in ML validation and measurement (Precision, Recall, Specificity, NPV, etc.), and experienced designing reward functions, evaluators, or grader models for reinforcement fine‑tuning and continuous improvement. Good understanding of LLM as judges for qualitative and semantic evaluations.
• Fluency in embeddings and vector stores — experienced in building or integrating retrieval‑augmented generation (RAG) pipelines, managing vector databases (e.g., FAISS, Pinecone, Chroma, Azure AI Search, or similar), and leveraging semantic search or context injection to enhance reasoning.
• Adapt and learn continuously — staying ahead of evolving AI architectures, agentic frameworks, and emerging paradigms in reasoning and retrieval. You have curiosity, humility, and a bias for iteration.

Machine Learning and LLMs

• A solid understanding of classical ML, and LLM fundamentals — knowledgeable in transformer architectures, attention mechanisms, and tokenization principles. You understand how embeddings, context windows, and model scaling laws influence quality, cost, and performance.
• Excellence in model fine‑tuning — with hands‑on expertise fine‑tuning large language models (LLMs) or multimodal models using supervised, reinforcement, or instruction‑tuning techniques (e.g., LoRA, PEFT, TRL). Skilled at optimizing model efficiency, interpretability, and inference performance.

Thought leadership

• Collaboration across boundaries — partnering with platform, application, and product engineers to transform concepts into scalable, reliable AI solutions. You communicate clearly, share knowledge openly, and thrive in cross‑functional teams.
• Solid engineering — grounded in strong software design principles, modular architecture, and code quality. You can translate experimental ideas into robust, maintainable systems that integrate seamlessly within large‑scale AI platforms.
• Demonstrating ownership — capable of setting technical direction, mentoring peers, and making pragmatic design trade‑offs that balance innovation, performance, and reliability.
• Acting with purpose — applying thoughtful engineering and ethical AI principles to create systems that advance healthcare intelligence responsibly and at scale.

Key Qualifications

• B.S. or M.S. in Computer Science, Artificial Intelligence, or a related technical field.
• 5+ years of industry experience building and deploying scalable, production‑ready ML systems in a collaborative engineering environment.
• Strong software engineering fundamentals, with proficiency in Python and experience designing scalable systems in modern cloud environments (Azure, AWS, or GCP). Experienced in modern development workflows such as code reviews, CI/CD pipelines, and collaborative development tools. Experience with debugging, testing, feature flags, experimentation and version control (Git). Exposure to Python‑based web services (FastAPI a plus) and containerized application development (Docker or Kubernetes).
• Proficiency with agentic AI frameworks (e.g., LangGraph, AutoGen, CrewAI) and understanding of interoperability protocols such as MCP and A2A. Deep experience with MCP (Model Context Protocol) architecture, AI systems or APIs, or large‑scale codebases is preferred.
• Experience working with vector databases and embeddings, integrating FAISS, Pinecone, Chroma, or Azure AI Search into retrieval‑augmented generation (RAG) or semantic‑search pipelines.
• Hands‑on experience fine‑tuning and optimizing large language models (LLMs) or multimodal models, using techniques such as LoRA, PEFT, and TRL.
• Strong communication and teamwork skills, with a pragmatic and collaborative approach to problem solving.

Why Truveta?

Be a part of building something special. Now is the perfect time to join Truveta. We have strong, established leadership with decades of success. We are well‑funded. We are building a culture that prioritizes people and their passions across personal, professional, and everything in between. Join us as we build an amazing company together.