Staff AI Engineer

Modmed; Hyderabad; Hybrid; INR 6,000,000 - 9,000,000; Full time

Benefits offered by this job

Meals & snacks

Health insurance

Wellness allowance

Paid parental leave

Company holidays

Job summary

ModMed in Hyderabad is seeking a Staff AI Engineer to help define and scale our AI-driven healthcare platform. You will lead hands-on development of generative AI, RAG pipelines, and agentic AI, collaborating with Product, Data Science, and healthcare experts to deliver reliable, production-ready systems.

Ideal candidates bring 8+ years in AI/ML, deep Python expertise, and experience with PyTorch, LangChain, Databricks, and AWS.

Qualifications

• 8+ years of experience in AI/ML, Data Science, or Software Engineering, with hands-on production AI systems.
• Strong expertise in LLMs, Generative AI, RAG, embeddings, and AI agents.
• Proficiency in Python and frameworks such as PyTorch, HuggingFace, LangChain, LangGraph, and LlamaIndex.
• Ability to design scalable, reliable AI architectures and translate business problems into production-ready solutions.
• Experience with APIs, distributed systems, testing, CI/CD, observability, and production operations.
• Familiarity with AWS or similar cloud platforms and platforms like Databricks, MLflow, SageMaker.
• Knowledge of AI evaluation, grounding, guardrails, and responsible AI practices.
• Track record of technical leadership, mentoring, and driving complex AI initiatives.

Responsibilities

• Define and architect scalable AI capabilities for ModMed’s platform, including LLM, Generative AI, and Agentic AI solutions.
• Lead end-to-end AI systems, including RAG pipelines, tool integration, and document intelligence.
• Establish reliability through LLM evaluation, observability, latency and cost optimization.
• Apply prompt engineering, model selection, and retrieval strategies to healthcare workflows.
• Define reusable AI engineering patterns and architecture standards across initiatives.
• Mentor senior and junior engineers and drive architectural decisions without direct management.
• Ensure compliance, privacy, and responsible AI in healthcare contexts.

Skills

AI/ML Leadership

Generative AI

LLMs & Agents

Prompt Engineering

Embeddings & Vector Search

Python

PyTorch

HuggingFace

LangChain

LangGraph

LlamaIndex

Cloud/AWS

Distributed Systems

CI/CD & Observability

Production AI

Tools

Databricks

MLflow

SageMaker

AWS Cloud

Job description

## Staff AI EngineerApply: Hybrid: Hyderabad, India: Full time: Posted 3 Days Ago: R5048**Join the Team Modernizing Medicine**At **ModMed**, we’re not just building software—we’re reimagining the healthcare experience. Founded in 2010 by a practicing physician and a successful tech entrepreneur, we took a radically different approach: **we hired doctors and taught them how to code.** This \"for doctors, by doctors\" philosophy has allowed us to create an AI-enabled, specialty-specific cloud platform that places patients at the center of care.**A Culture of Excellence**When you join ModMed, you’re joining an award-winning team recognized for innovation and employee satisfaction. From our global headquarters in Boca Raton Florida, and extensive employee base in Hyderabad India, we are a team of 4,500+ passionate problem-solvers on a mission to increase medical practice success and improve patient outcomes:* **Consistently ranked as a Top Place to Work*** **2025 Globee Business Awards:** Gold Globee for “Technology Team of the Year”* **2025 Black Book Awards:** Ranked #1 EHR in 11 Specialties* **Florida Venture Forum:** Venture-Backed Company of the YearWe are growing fast, thinking big, and we are just getting started.**Ready to modernize medicine with us?****Job Description Summary:**## **Why ModMed?**At ModMed, we are on a mission to place doctors and patients at the center of care through an intelligent, specialty-specific cloud platform. We envision a world where our software increases medical-practice success and improves patient outcomes.We don't just build code; we innovate boldly to save time for healthcare providers so they can focus on what matters most. If you want to align your passion with purpose and use AI to do good in the world, you belong here.## **The Opportunity**We are looking for a **Staff AI Engineer** who dreams big, thinks strategically, and builds hands-on. In this role, you will help define and architect the next generation of AI capabilities at ModMed—from **Generative AI and LLM applications to Agentic AI, RAG, and intelligent automation**.You will operate as a **technical leader and hands-on engineer**, solving complex problems, establishing scalable AI patterns, and taking AI capabilities from concept to reliable production systems. You will work closely with Product, Engineering, Data Science, and healthcare domain experts to turn emerging AI technologies into meaningful customer outcomes.## **How You’ll Make an Impact*** **Architect AI Innovation:** Design and build scalable, production-grade **LLM, Generative AI, and Agentic AI solutions** that solve complex healthcare and medical-practice workflows.* **Build AI Systems End-to-End:** Lead the architecture and implementation of **RAG pipelines, AI agents, orchestration, tool calling, document intelligence, and intelligent automation** from prototype through production.* **Engineer for Reliability:** Establish robust approaches for **LLM evaluation, grounding, guardrails, observability, security, latency, and cost optimization** to ensure AI systems are reliable and production-ready.* **Solve Complex Problems:** Apply advanced **prompt engineering, model selection, fine-tuning, retrieval strategies, and ML techniques** to address specialty-specific healthcare challenges.* **Drive Technical Excellence:** Define reusable AI engineering patterns, architecture standards, and best practices that can be adopted across ModMed's AI initiatives.* **Lead Without Authority:** Partner with Product, Engineering, Data Science, and domain experts to influence technical direction, make architecture decisions, and drive successful delivery of high-impact AI initiatives.* **Mentor & Multiply:** Mentor senior and junior engineers, conduct technical design reviews, and raise the engineering and AI maturity of the broader organization.* **Innovate Responsibly:** Help ensure AI solutions are **secure, explainable, governable, and appropriate for healthcare**, with strong attention to privacy, compliance, and responsible AI practices.## **What You Bring to the Team**### **The Essentials:*** **Experience:** 8+ years of experience in AI/ML, Machine Learning, Data Science, or Software Engineering, with significant hands-on experience building production AI systems.* **Generative AI Expertise:** Deep hands-on experience with **LLMs, Generative AI, RAG, prompt engineering, embeddings, vector search, and AI agents**.* **Technical Mastery:** Strong proficiency in **Python** and experience with modern AI/ML frameworks such as **PyTorch, Hugging Face, LangChain, LangGraph, LlamaIndex**, or equivalent technologies.* **AI Architecture:** Proven ability to design **scalable, reliable AI/ML architectures** and translate ambiguous business problems into production-ready technical solutions.* **Production Engineering:** Strong software engineering fundamentals, including **APIs, distributed systems, testing, CI/CD, observability, and production operations**.* **Cloud & ML Platforms:** Experience deploying AI/ML solutions at scale using **AWS** or equivalent cloud platforms, with experience in platforms such as **Databricks, MLflow, SageMaker**, or similar technologies.* **AI Evaluation & Quality:** Strong understanding of **LLM evaluation, hallucination mitigation, grounding, model quality, and AI observability**.* **Technical Leadership:** Demonstrated ability to influence architecture and technical direction, mentor engineers, and lead complex initiatives without necessarily having direct people-management responsibility.### **Bonus Points:*** Experience building **multi-agent / Agentic AI systems** with orchestration, planning, memory, and tool use.* Experience with **document intelligence, OCR, document classification, information extraction, and multimodal AI**.* Experience working with **healthcare AI, clinical workflows, medical data, RCM, billing, or claims**.* Familiarity with healthcare standards such as **FHIR, HL7, X12/EDI**, or similar healthcare data formats.* Experience with **HIPAA, healthcare data privacy, AI security, and responsible AI**.* Experience working with foundation models such as **OpenAI, Anthropic, Llama, Mistral**, or equivalent.* Experience optimizing **LLM inference cost, latency, scalability, and reliability**.## **Our Culture & Values**We believe in **Thinking Big and Having Fun**. At ModMed, you'll find a team that is high-performing but humble. We move fast to make things happen, but we never lose sight of our goal: to save time for doctors and improve the lives of patients.As a Staff AI Engineer, you'll have the opportunity to shape not just individual AI solutions, but **how ModMed builds and scales AI across the organization**.**We align passion with purpose. Come help us build the future of healthcare.** ***ModMed Benefits Highlight:*** At ModMed, we believe it’s important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce. Eligible Modernizers can enroll in a wide range of benefits:* Meals & Snacks: Enjoy complimentary office lunches & dinners on select days and healthy snacks delivered to your desk,* Insurance Coverage: Comprehensive health, accidental, and life insurance plans, including coverage for family members, all at no cost to employees,* Allowances: Annual wellness allowance to support your well-being and productivity,* Earned, casual, and sick leaves to maintain a healthy work-life balance,* Bereavement leave for difficult times and extended medical leave options,* Paid parental leaves, including maternity, paternity, adoption, surrogacy, and abortion leave,* Celebration leave to make your special day even more memorable, and company-paid holidays to recharge and unwind.