Principal II AI Platform Engineer, GenAI

Teladoc Health, Inc.

United States

Remote

USD 250,000 - 300,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Teladoc Health, Inc. is seeking a Principal II Data & AI Platform Engineer to architect, build, and scale production GenAI applications and agentic systems. You will drive AI architecture decisions, agent infra, and Databricks integration, while contributing to design and implementation.

The role demands a strong background in traditional ML/DL and substantial recent GenAI engineering, with hands-on leadership and cross-team collaboration in a high-scale healthcare context.

Qualifications

  • 12+ years building and running production systems across software, platform, or ML eng.
  • 5+ years Databricks production-scale experience: Lakehouse, Unity Catalog, Delta Lake.
  • Strong Python and production AI service delivery experience with CI/CD and monitoring.
  • Proven GenAI/LLM production experience for 3+ years, with agentic APIs or workflows.
  • Knowledge of agent architecture: orchestration, tool calling, RAG, vector retrieval.

Responsibilities

  • Lead architecture and hands-on development of production GenAI apps and member-facing AI agents.
  • Design reusable agent infrastructure: orchestration, tool calling, RAG, vector retrieval, context management.
  • Architect Databricks platforms for model serving, retrieval, and governance with secure patterns.
  • Make cross-team AI architecture decisions and drive build-vs-buy decisions.
  • Establish production AI engineering practices: testing, CI/CD, model/prompt versioning, observability.
  • Build safe AI systems with PHI/PII protections, guardrails, access controls, and cost monitoring.
  • Mentor engineers, set AI standards, and communicate decisions to leaders while hands-on.
  • Participate in on-call for production AI incidents.

Skills

Python
Databricks
AI architecture
CI/CD
MLOps
Spark/PySpark
Vector search
Observability

Education

Bachelor’s degree in CS/Engineering/ML

Tools

Databricks
Unity Catalog
Delta Lake
MLflow
Vector Search

Job description

Join the team leading the next evolution of virtual care.

At Teladoc Health, you are empowered to bring your true self to work while helping millions of people live their healthiest lives.

Here you will be part of a high-performance culture where colleagues embrace challenges, drive transformative solutions, and create opportunities for growth. Together, we’re transforming how better health happens.

Summary of Position

We are seeking a Principal II Data & AI Platform Engineer to serve as one of the most senior hands‑on technical leaders on our Data & AI Platform team. This role will architect, build, and scale production generative AI applications and agentic systems, including member‑facing experiences. You will drive technical decisions for AI architecture, agent infrastructure, and integration with our Databricks ecosystem while directly contributing to design and implementation.

The ideal candidate brings a strong foundation in traditional machine learning and deep learning, followed by substantial recent experience engineering production GenAI solutions. This is a highly influential individual contributor role with technical decision‑making authority, cross‑team leadership, and an opportunity to shape how Teladoc delivers reliable, secure AI at scale.

Essential Duties and Responsibilities
  • Lead the architecture and hands‑on development of production GenAI applications, including member‑facing AI agents, conversational experiences, and API‑based workflows.
  • Design and build reusable agent infrastructure, including orchestration, tool/function calling (such as MCP), RAG, vector search, context management, and model integrations.
  • Architect AI solutions on Databricks, including platform integration, model serving, retrieval, and governance, with secure and reusable patterns for enterprise applications.
  • Make cross‑team technical decisions on AI architecture, scalability, platform integrations, and build‑versus‑buy tradeoffs, while remaining accountable for implementation.
  • Establish production AI engineering practices for evaluation, automated testing, CI/CD, model/prompt versioning, observability, and troubleshooting.
  • Build safe, reliable AI systems with PHI/PII protections, guardrails, access controls, and performance and cost monitoring.
  • Partner with product, engineering, data, security, and compliance teams to deliver member‑facing AI capabilities and integrate AI into enterprise applications.
  • Mentor engineers, set AI engineering standards, and communicate technical decisions to engineering leaders and executives while remaining deeply hands‑on.
  • Participate in on‑call support as a senior escalation resource for production AI incidents.

The time spent on each responsibility reflects an estimate and is subject to change dependent on business needs.

Supervisory Responsibilities

No

Qualifications Expected for Position
  • Bachelor’s degree in Computer Science, Engineering, Machine Learning, or a related field, or equivalent practical experience.
  • 12+ years of experience building and running production systems (software, platform, or ML engineering). A proven record of setting technical direction for large, multi‑team initiatives and defining architectures and standards used across the company.
  • 5+ years of hands‑on Databricks experience at production scale: Lakehouse architecture, Unity Catalog, Delta Lake
  • Spark/PySpark performance tuning
  • Workflows and Databricks SQL
  • Cost management (cluster policies, serverless compute)
  • Strong hands‑on foundation in traditional machine learning or deep learning, predating widespread GenAI adoption, followed by recent, substantial agentic GenAI engineering experience.
  • Proven experience personally building, deploying, and operating production GenAI/LLM applications (ideally 3+ years), such as agentic APIs, workflows, or conversational products.
  • Strong knowledge of agent architecture, including orchestration, tool calling, RAG, vector retrieval, context management, evaluation, and observability.
  • Strong Python skills and experience delivering production AI services or APIs, with CI/CD, testing, monitoring, and operational troubleshooting.
  • Ability to lead through technical authority, mentor engineers, collaborate across teams, and design secure, reliable systems while remaining a hands‑on individual contributor.
Bonus Qualifications
  • Hands‑on experience with Databricks Mosaic AI, Unity Catalog, Delta Lake, MLflow, Vector Search, or Databricks Asset Bundles.
  • Experience with Snowflake, dbt, Terraform, Spark/PySpark, or broader data lakehouse infrastructure.
  • Experience with AI applications in healthcare or other regulated environments, including HIPAA or responsible AI frameworks.
  • Familiarity with complementary AI/cloud frameworks and tools such as LangGraph, Semantic Kernel, Azure AI Foundry, Docker, or Kubernetes.
  • Relevant Databricks or cloud AI certifications, open‑source contributions, publications, or conference presentations.

The base salary range for this position is$250,000 - $300,000.In addition to a base salary, this position is eligible for performance bonus, RSU’s, and benefits (subject to eligibility requirements) listed here: Teladoc Health Benefits 2026 Total compensation is based on several factors including, but not limited to, type of position, location, education level, work experience, and certifications.This information is applicable for all full‑timepositions.

#LI-SS2 #LI-Remote

We follow a Flexible Vacation Policy, intended for rest, relaxation, and personal time. All time off must be approved by your manager prior to use. You will also receive 80 hours of Paid Sick, Safe, and Caregiver Leave annually. This applies to full‑time positions only. If you are applying for a part‑time role, your recruiter can provide additional details.

As part of our hiring process, we verify identity and credentials, conduct interviews (live or video), and screen for fraud or misrepresentation. Applicants who falsify information will be disqualified.

Teladoc Health will not sponsor or transfer employment work visas for this position. Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future.

Why join Teladoc Health?
  • Teladoc Health is transforming how better health happens. Learn how when you join us in pursuit of our impactful mission (https://www.teladochealth.com/about).
  • Chart your career path with meaningful opportunities that empower you to grow, lead, and make a difference.
  • Join a multi‑faceted community that celebrates each colleague’s unique perspective and is focused on continually improving, each and every day.
  • Contribute to an innovative culture where fresh ideas are valued as we increase access to care in new ways.
  • Enjoy an inclusive benefits program (https://www.teladochealth.com/careers/benefits) centered around you and your family, with tailored programs that address your unique needs.
  • Explore candidate resources (https://www.teladochealth.com/careers/candidate-resources) with tips and tricks from Teladoc Health recruiters and learn more about our company culture by exploring #TeamTeladocHealth on LinkedIn (https://www.linkedin.com/search/results/all/?keywords=%23TeamTeladocHealth%20&origin=GLOBAL_SEA…).

As an Equal Opportunity Employer, we never have and never will discriminate against any job candidate or employee due to age, race, religion, color, ethnicity, national origin, gender, gender identity/expression, sexual orientation, membership in an employee organization, medical condition, family history, genetic information, veteran status, marital status, parental status, or pregnancy). In our innovative and inclusive workplace, we prohibit discrimination and harassment of any kind.

Teladoc Health respects your privacy and is committed to maintaining the confidentiality and security of your personal information. In furtherance of your employment relationship with Teladoc Health, we collect personal information responsibly and in accordance with applicable data privacy laws, including but not limited to, the California Consumer Privacy Law (CCPA). Personal information is defined as: Any information or set of information relating to you, including (a) all information that identifies you or could reasonably be used to identify you, and (b) all information that any applicable law treats as personal information. Teladoc Health’s Notice of Privacy Practices for U.S. Employees’ Personal information is available at this link .

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal II AI Platform Engineer, GenAI
Principal II AI Platform Engineer, GenAI

Teladoc Health • United States

Remote
USD 250,000 - 300,000
Principal II AI Platform Engineer, GenAI
Principal II AI Platform Engineer, GenAI

Teladoc Health, Inc. • New York (NY)

Hybrid
USD 250,000 - 300,000
Teladoc Health Benefits
Director, Software Engineering, Healthcare Interoperability
Director, Software Engineering, Healthcare Interoperability

Teladoc Health • United States

Remote
USD 180,000 - 215,000
Flexible vacation policy
Paid sick leave
Caregiver leave
+1
Director, Software Engineering, Healthcare Interoperability
Director, Software Engineering, Healthcare Interoperability

Teladoc Health, Inc. • New York (NY)

Hybrid
USD 180,000 - 215,000
Manager, Release & Change Engineering
Manager, Release & Change Engineering

Teladoc Health • New York (NY)

On-site
USD 131,000 - 150,000
Product Management Lead, Communication Platform
Product Management Lead, Communication Platform

Teladoc Health • United States

Remote
USD 180,000 - 220,000
Flexible vacation policy
Health benefits
Career growth opportunities
Account Executive
Account Executive

Teladoc Health • Purchase (NY)

On-site
USD 115,000 - 120,000
Commission
Benefits
Flexible vacation policy
+2
Staff Zero Trust Security Engineer
Staff Zero Trust Security Engineer

Teladoc Health • United States

Remote
USD 165,000 - 185,000
Flexible vacation policy
Paid sick leave
Caregiver leave
Principal Product Manager, Member Experience
Principal Product Manager, Member Experience

Teladoc Health, Inc. • New York (NY)

Hybrid
USD 200,000 - 230,000
Flexible vacation policy
Paid sick leave
Senior Associate - Health Plans
Senior Associate - Health Plans

Teladoc Health, Inc. • Massachusetts

Hybrid
USD 75,000 - 85,000
Performance bonus
Benefits package
Flexible vacation policy
+1