Principal II AI Platform Engineer, GenAI

Teladoc Health, Inc.; New York (NY); Hybride; USD 250 000 - 300 000; Plein temps

Avantages offerts par ce poste

Teladoc Health Benefits

Résumé du poste

Teladoc Health, Inc. seeks a Principal II Data & AI Platform Engineer to architect, build, and scale production GenAI applications and agentic systems, including member‑facing experiences. You will steer AI architecture, agent infrastructure, and Databricks ecosystem integration while contributing to design and implementation.

The role combines senior technical leadership with hands‑on development, setting standards for AI engineering, monitoring, and security across enterprise applications.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Machine Learning, or related field.
• 12+ years of experience building and running production systems.
• 5+ years of hands-on Databricks experience at production scale.

Responsabilités

• Lead architecture and hands‑on development of production GenAI apps and member‑facing AI agents.
• Design reusable agent infrastructure including orchestration, RAG, vector search, and tool calls.
• Architect AI solutions on Databricks with secure, enterprise patterns.
• Make cross‑team technical decisions on architecture and platform integrations.
• Establish production AI engineering practices: testing, CI/CD, versioning, observability.
• Build safe, reliable AI systems with PHI/PII protections and cost monitoring.
• Mentor engineers and communicate decisions to leaders while remaining hands‑on.
• Participate in on‑call support for production AI incidents.

Connaissances

Python

CI/CD

Production AI

Observability

Mentoring

Cross-team leadership

Formation

Bachelor’s degree in CS/Engineering/ML or related field

Outils

Databricks

Unity Catalog

Delta Lake

MLflow

Vector Search

Description du poste

Summary of Position

We are seeking a Principal II Data & AI Platform Engineer to serve as one of the most senior hands‑on technical leaders on our Data & AI Platform team. This role will architect, build, and scale production generative AI applications and agentic systems, including member‑facing experiences. You will drive technical decisions for AI architecture, agent infrastructure, and integration with our Databricks ecosystem while directly contributing to design and implementation. The ideal candidate brings a strong foundation in traditional machine learning and deep learning, followed by substantial recent experience engineering production GenAI solutions. This is a highly influential individual contributor role with technical decision‑making authority, cross‑team leadership, and an opportunity to shape how Teladoc delivers reliable, secure AI at scale.

Essential Duties and Responsibilities

• Lead the architecture and hands‑on development of production GenAI applications, including member‑facing AI agents, conversational experiences, and API‑based workflows.
• Design and build reusable agent infrastructure, including orchestration, tool/function calling (such as MCP), RAG, vector search, context management, and model integrations.
• Architect AI solutions on Databricks, including platform integration, model serving, retrieval, and governance, with secure and reusable patterns for enterprise applications.
• Make cross‑team technical decisions on AI architecture, scalability, platform integrations, and build‑versus‑buy tradeoffs, while remaining accountable for implementation.
• Establish production AI engineering practices for evaluation, automated testing, CI/CD, model/prompt versioning, observability, and troubleshooting.
• Build safe, reliable AI systems with PHI/PII protections, guardrails, access controls, and performance and cost monitoring.
• Partner with product, engineering, data, security, and compliance teams to deliver member‑facing AI capabilities and integrate AI into enterprise applications.
• Mentor engineers, set AI engineering standards, and communicate technical decisions to engineering leaders and executives while remaining deeply hands‑on.
• Participate in on‑call support as a senior escalation resource for production AI incidents.

The time spent on each responsibility reflects an estimate and is subject to change dependent on business needs.

No Qualifications Expected for Position

Bachelor’s degree in Computer Science, Engineering, Machine Learning, or a related field, or equivalent practical experience.

• 12+ years of experience building and running production systems (software, platform, or ML engineering).
• A proven record of setting technical direction for large, multi‑team initiatives and defining architectures and standards used across the company.
• 5+ years of hands‑on Databricks experience at production scale: Lakehouse architecture, Unity Catalog, Delta Lake Spark/PySpark performance tuning.
• Workflows and Databricks SQL Cost management (cluster policies, serverless compute).
• Strong hands‑on foundation in traditional machine learning or deep learning, predating widespread GenAI adoption, followed by recent, substantial agentic GenAI engineering experience.
• Proven experience personally building, deploying, and operating production GenAI/LLM applications (ideally 3+ years), such as agentic APIs, workflows, or conversational products.
• Strong knowledge of agent architecture, including orchestration, tool calling, RAG, vector retrieval, context management, evaluation, and observability.
• Strong Python skills and experience delivering production AI services or APIs, with CI/CD, testing, monitoring, and operational troubleshooting.
• Ability to lead through technical authority, mentor engineers, collaborate across teams, and design secure, reliable systems while remaining a hands‑on individual contributor.

Bonus Qualifications

• Hands‑on experience with Databricks Mosaic AI, Unity Catalog, Delta Lake, MLflow, Vector Search, or Databricks Asset Bundles.
• Experience with Snowflake, dbt, Terraform, Spark/PySpark, or broader data lakehouse infrastructure.
• Experience with AI applications in healthcare or other regulated environments, including HIPAA or responsible AI frameworks.
• Familiarity with complementary AI/cloud frameworks and tools such as LangGraph, Semantic Kernel, Azure AI Foundry, Docker, or Kubernetes.
• Relevant Databricks or cloud AI certifications, open‑source contributions, publications, or conference presentations.

The base salary range for this position is $250,000 - $300,000. In addition to a base salary, this position is eligible for performance bonus, RSU’s, and benefits (subject to eligibility requirements) listed here: Teladoc Health Benefits.

Teladoc Health will not sponsor or transfer employment work visas for this position. Applicants must be currently authorized to work in the United States without the need for visa sponsorship now or in the future.

Teladoc Health Benefits 2026

Total compensation is based on several factors including, but not limited to, type of position, location, education level, work experience, and certifications. This information is applicable for all full‑time positions.

We follow a Flexible Vacation Policy, intended for rest, relaxation, and personal time. All time off must be approved by your manager prior to use.

You will also receive 80 hours of Paid Sick, Safe, and Caregiver Leave annually. This applies to full‑time positions only. If you are applying for a part‑time role, your recruiter can provide additional details.

Why join Teladoc Health?

Teladoc Health is transforming how better health happens. Learn how when you join us in pursuit of our impactful mission. Chart your career path with meaningful opportunities that empower you to grow, lead, and make a difference. Join a multi‑faced community that celebrates each colleague’s unique perspective and is focused on continually improving, each and every day. Contribute to an innovative culture where fresh ideas are valued as we increase access to care in new ways. Enjoy an inclusive benefits program centered around you and your family, with tailored programs that address your unique needs. Explore candidate resources with tips and tricks from Teladoc Health recruiters and learn more about our company culture by exploring #TeamTeladocHealth on LinkedIn.

As an Equal Opportunity Employer, we never have and never will discriminate against any job candidate or employee due to age, race, religion, color, ethnicity, national origin, gender, gender identity/expression, sexual orientation, membership in an employee organization, medical condition, family history, genetic information, veteran status, marital status, parental status, or pregnancy). In our innovative and inclusive workplace, we prohibit discrimination and harassment of any kind. Teladoc Health respects your privacy and is committed to maintaining the confidentiality and security of your personal information.

In furtherance of your employment relationship with Teladoc Health, we collect personal information responsibly and in accordance with applicable data privacy laws, including but not limited to, the California Consumer Privacy Act (CCPA). Personal information is defined as: Any information or set of information relating to you, including (a) all information that identifies you or could reasonably be used to identify you, and (b) all information that any applicable law treats as personal information. Teladoc Health’s Notice of Privacy Practices for U.S. Employees’ Personal information is available at this link.

Teladoc Health’s mission is to empower all people everywhere to live their healthiest lives.