Senior AI Engineer

Jobtailor; New York (NY); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Short & Long Term Disability

Life Insurance

401k with company match

Paid Time Off

Paid Parental Leave

Job summary

Lantern is seeking a Senior AI Engineer to drive the design, development, and scaling of Generative AI and agentic systems. You will own production LLM-powered applications, mentor engineers, and partner with cross-functional teams to deliver production-grade AI solutions for healthcare contexts.

You will set engineering standards, evaluate models, manage LLMOps, and ensure compliance, safety, and observability while leading architecture discussions and driving AI initiatives at scale.

Qualifications

• 5+ years building and deploying production AI/ML systems.
• Strong Python proficiency and software engineering fundamentals.
• Experience with healthcare or regulated environments is a plus.
• Proven leadership and collaboration across cross-functional teams.

Responsibilities

• Design and deploy production AI/ML systems and GenAI capabilities.
• Lead architecture decisions for multi-agent workflows and agentic systems.
• Mentor engineers and strengthen AI engineering practices.
• Partner with product, clinical ops, and data teams to deliver scalable AI solutions.

Skills

Python

AI/ML engineering

Leadership

Communication

Problem solving

Education

Bachelor's or Master's in CS/Engineering

Tools

Azure

Docker

Kubernetes

LangChain/LangGraph

OpenAI/Azure OpenAI

Job description

About Lantern

Lantern is the specialty care platform connecting people with the best care when they need it most. By curating a Network of Excellence comprised of the nation’s top specialists for surgery, cancer care, infusions and more, Lantern delivers excellent care with significant cost savings to employers and their workforces. Lantern also pairs members with a dedicated care team, including Care Advocates and nurses, for the entirety of their care journey, helping them get back to good health, back to their families and back to work. With convenient access to specialists nationwide, Lantern means quality care is within driving distance for most. Lantern is trusted by the nation’s largest employers to deliver care to more than 6 million members across the country. Learn more about us at lanterncare.com.

About You

You use LOGIC in your decision making and understand that progress is critical to making change. You focus on the execution of your content while balancing a fast-paced environment and you take the time to celebrate both the small & big wins. INCLUSION is a core tenant of your personal beliefs. A diverse and inclusive environment is incredibly important to you. You understand and desire to be a part of a diverse team with different experiences and perspectives & you cherish the differences in each individual that you interact with. You have the GRIT , drive and ambition to tackle big problems. Big problems require big ideas and a team that supports new ideas. You care deeply for your customers are driven to keep HUMANITY in all decisions. Your customers aren’t just the individuals using your product. They are the driving factor in your motivation to make a change. Integrity guides you in life. Focusing on the TRUTH vs. giving people the answers they want to hear. You thrive in a Team Environment. Collaboration is key in innovation and creating change. These pillars of LIGHT are a reminder to our team that we are making a difference by providing guidance and support in navigating the often complex and confusing landscape of healthcare. We hope that through this LIGHT, individuals can find their way to the best care, resources, and support they need to get back to life.

Senior AI Engineer

Lantern is seeking a Senior AI Engineer to drive the design, development, and scaling of our Generative AI and agentic systems. In this role, you will take technical ownership of complex LLM‑powered applications and multi‑agent workflows, set the engineering standard for AI development practices, and partner closely with engineering leadership, product, clinical operations, and data teams to translate strategic priorities into production‑grade AI solutions. You are a seasoned AI practitioner who has shipped production LLM and agentic systems, can reason through architectural trade‑offs, and brings both depth (GenAI, RAG, agents, LLMOps) and breadth (software engineering, data infrastructure, cloud platforms). Beyond building, you will lead design and code reviews, mentor engineers, and actively shape how Lantern builds and operates AI at scale in a regulated healthcare environment.

Locations

We prefer Hybrid - at least 3 days/wk in either our Dallas, TX or New York, NY offices

Responsibilities

• Generative AI & LLM Architecture Architect and deliver production LLM‑powered capabilities including advanced RAG pipelines, structured extraction, multi‑document reasoning, dialogue systems, and domain‑specific language models.


• Own prompt engineering strategy: design versioned, testable prompt pipelines; establish team standards for prompt management, evaluation, and continuous improvement.


• Lead the selection and integration of embedding models, vector databases (e.g., Azure AI Search, Pinecone, Weaviate), and hybrid retrieval architectures; drive systematic retrieval quality improvement.


• Define and implement LLM evaluation frameworks and automated quality benchmarks; establish guardrails, grounding strategies, and hallucination mitigation controls meeting healthcare compliance standards.


• Evaluate frontier and open‑source models (GPT‑4.5, GPT‑5.x, Claude, Gemini, Llama, Mistral, etc.); lead model selection decisions and maintain awareness of the evolving AI landscape to inform roadmap choices.


• Agentic Systems Design & Leadership Lead the architecture and implementation of production agentic systems — including multi‑agent orchestration, planning, tool‑use, memory, and state persistence — using frameworks such as LangGraph, AutoGen, CrewAI, or custom layers.


• Design robust human‑in‑the‑loop mechanisms, approval workflows, fallback strategies, and audit trails to ensure agentic systems meet safety, compliance, and clinical trust requirements.


• Establish patterns for tool‑use and function‑calling that allow agents to interact reliably with external APIs, clinical systems, and internal data services.


• Define standards for agent observability: trace logging, step‑level monitoring, behavioral drift detection, and structured evaluation of multi‑step agent runs.


• Engineering Leadership & MLOps Write production‑quality, modular, and well‑tested code; set the technical bar through rigorous design and code reviews across the AI engineering team.


• Architect and maintain LLM inference services, API integrations, and supporting data pipelines on Azure; drive performance, reliability, and cost optimization.


• Define and champion LLMOps practices: prompt versioning, experiment tracking, model registration, A/B testing, CI/CD for AI pipelines, and automated regression testing for LLM outputs.


• Establish production monitoring and observability for AI systems: latency, quality scores, cost tracking, safety metrics, and behavioral drift alerting.


• Lead technical documentation: architecture decision records, runbooks, model cards, and evaluation playbooks.


• Cross‑Functional Partnership & Mentorship Serve as the primary technical partner for product, clinical operations, marketing, and data teams; translate complex requirements into well‑scoped, high‑impact AI initiatives.


• Mentor and grow junior and mid‑level engineers through pairing, design reviews, knowledge‑sharing, and feedback on AI engineering practices.


• Lead architecture discussions and contribute to the AI engineering roadmap; represent the team’s technical perspective in cross‑functional planning.


• Drive adoption of GenAI and agentic capabilities across the organization by communicating technical concepts clearly to non‑engineering stakeholders.

Experience & Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent practical experience.


• 5+ years of experience building and deploying production AI/ML systems, with at least 2–3 years focused on LLM and GenAI applications.


• Strong proficiency in Python and software engineering fundamentals (testing, modular design, code reviews, documentation, version control).


• Deep hands‑on experience with LLM APIs (OpenAI, Azure OpenAI, Anthropic, Google, etc.) and advanced prompt engineering: chain‑of‑thought, few‑shot, structured outputs, tool‑calling, and multi‑turn dialogue.


• Proven experience designing and deploying production RAG systems: document processing, chunking strategies, embedding models, vector databases, hybrid retrieval, and retrieval evaluation.


• Hands‑on experience with agentic frameworks (LangChain, LangGraph, AutoGen, CrewAI, or custom orchestration) and production deployment of multi‑step agent workflows.


• Experience with LLM evaluation tooling (e.g., RAGAS, TruLens, DeepEval, or custom frameworks) and systematic approaches to measuring and improving output quality.


• Experience with cloud platforms (preferably Azure) and containerized deployment (Docker, Kubernetes); familiarity with LLMOps/MLOps tooling (MLflow, Azure ML, W&B).


• Strong communication and collaboration skills; proven ability to lead technical discussions and influence cross‑functional partners.


• Track record of mentoring engineers and elevating team engineering standards.


• Strong Candidates Will Also Have Experience implementing safety, grounding, and compliance controls for AI systems in regulated industries (healthcare, finance, legal, etc.), including audit logging and PII handling.


• Working knowledge of fine‑tuning, RLHF, DPO, or parameter‑efficient adaptation (LoRA, QLoRA) of open‑source models for domain‑specific tasks.


• Experience with healthcare data, clinical documentation (e.g., clinical notes, ADT feeds), or claims workflows.


• Architecture‑level experience designing multi‑agent systems at scale, including agent coordination patterns, distributed state management, and failure recovery.


• Experience with streaming data pipelines, real‑time inference, or event‑driven AI architectures.


• Contributions to open‑source AI/LLM projects, applied research publications, or conference presentations.

Benefits

• Medical Insurance


• Dental Insurance


• Vision Insurance


• Short & Long Term Disability


• Life Insurance


• 401k with company match


• Paid Time Off


• Paid Parental Leave

Lantern does not discriminate on the basis of race, sex, color, religion, age, national origin, marital status, disability, veteran status, genetic information, sexual orientation, gender identity or any other reason prohibited by law in provision of employment opportunities and benefits.