Staff ML Engineer, AI Platform Architect

Lyra Health; New York (NY); On-site; USD 161,000 - 222,000; Full time

Benefits offered by this job

Healthcare coverage

Equity in the company

401K with matching

Monthly tech allowance

Paid parental leave

Job summary

Lyra Health in New York, NY seeks a Staff ML/AI Engineer to define and drive the architectural vision for Lyra’s machine learning and generative AI platforms. You will anchor the engineering and data organizations, architect enterprise-scale AI tech, and ensure reliable, secure, and medically precise AI products.

This role demands translating healthcare challenges into scalable platform solutions and elevating technical standards across teams.

Qualifications

• 8+ years of experience deploying complex ML/AI solutions into production
• Mastery of Python, RESTful API design, Protobuf, and microservices architecture
• Deep expertise with Docker, Kubernetes, container orchestration, and real-time inference services
• Experience designing and deploying RAG pipelines, fine-tuning LLMs, managing vector databases
• Cloud architecture on AWS or equivalent
• Ability to distill complex problems into strategic priorities and influence leadership

Responsibilities

• Design and execute the long-term roadmap for Lyra’s ML/AI platform
• Architect end-to-end training, fine-tuning, and low-latency inference platforms
• Establish standards for AI/ML SDLC including data lineage, CI/CD, evaluation, and monitoring
• Collaborate with Product, Data Science, Security, and Clinical leaders to map clinical goals to AI capabilities
• Mentor Senior ML Engineers and drive engineering best practices
• Lead by example with technical prototypes and strategic coding contributions
• Contribute hands-on coding to projects

Skills

Python

RESTful API design

Protobuf

microservices architecture

LLM evaluation frameworks

RAG pipelines

cloud architecture

strategic communication

Tools

Docker

Kubernetes

vector databases

Celery

Kafka

Job description

Lyra Health in New York, NY seeks a Staff ML/AI Engineer to define and drive the architectural vision for Lyra’s machine learning and generative AI platforms. You will anchor the engineering and data organizations, architect enterprise-scale AI tech, and ensure reliable, secure, and medically precise AI products.

This role demands translating healthcare challenges into scalable platform solutions and elevating technical standards across teams.