Senior Machine Learning Platform Engineer

Charlie Health; New York (NY); On-site; USD 170,000 - 220,000; Full time

Job summary

Charlie Health, located in New York City, is hiring an ML Platform Engineer to lead and build foundational systems for their AI capabilities. This role demands solid experience in software engineering and a keen understanding of ML infrastructure.

Ideal candidates will have at least 4 years of professional experience with a strong foundation in Python, cloud ML services, and infrastructure as code. The role requires 4 days in the NYC office, and offers a salary between $170,000 to $220,000 annually.

Qualifications

• 4+ years of professional experience in software engineering.
• At least 2 years focused on ML infrastructure and AI systems engineering.
• Strong software engineering fundamentals and deep infrastructure expertise.

Responsibilities

• Define technical direction for ML/AI infrastructure.
• Design and operate multi-vendor AI infrastructure.
• Develop high-performance GPU inference pipelines.

Skills

Python

Cloud ML services (AWS SageMaker, GCP Vertex AI)

Infrastructure as code (Terraform, Pulumi)

Container orchestration (Kubernetes, ECS)

Systems language (Go, Rust, C++)

Job description

Why Charlie Health?

Millions of people across the country are navigating mental health conditions, substance use disorders, and eating disorders, but too often, they’re met with barriers to care. From limited local options and long wait times to treatment that lacks personalization, behavioral healthcare can leave people feeling unseen and unsupported.

Charlie Health exists to change that. Our mission is to connect the world to life‑saving behavioral health treatment. We deliver personalized, virtual care rooted in connection—between clients and clinicians, care teams, loved ones, and the communities that support them. By focusing on people with complex needs, we’re expanding access to meaningful care and driving better outcomes from the comfort of home.

As a rapidly growing organization, we’re reaching more communities every day and building a team that’s redefining what behavioral health treatment can look like. If you’re ready to use your skills to drive lasting change and help more people access the care they deserve, we’d love to meet you.

About the Role

Charlie Health leads the nation in high‑acuity virtual behavioral care, having delivered life‑saving treatment to more than 100,000 clients nationwide. Our ML and AI capabilities are expanding rapidly—powering recommendation systems, clinical decision support, agentic AI products, and developer tooling—and the infrastructure underneath needs to scale with them.

As our first dedicated ML Platform Engineer, you’ll define the technical direction and build the foundational systems that our data scientists, ML engineers, and product teams depend on to ship AI‑powered features reliably and at scale. We have several models in production today and are investing in hosted GPU inference to support the next generation of our AI capabilities. You’ll inherit and evolve existing infrastructure while building new platform capabilities—from multi‑tenant model serving and GPU inference pipelines to multimodal data management, evaluation frameworks, observability, and infrastructure as code. You’ll own the platform layer that makes ML/AI development at Charlie Health fast, safe, and repeatable as the team grows. If you care about building the systems that let others build great things, this team is for you.

Responsibilities

Infrastructure & Serving

• Define technical direction for ML/AI infrastructure and make build‑vs‑buy decisions as the founding platform engineer
• Design and operate multi‑vendor AI infrastructure supporting client‑facing and clinician‑facing LLM applications across multiple LLM providers
• Design, build, and operate production model serving systems; maintain infrastructure as code for reproducible ML environments, training pipelines, and deployment workflows
• Develop high‑performance GPU inference pipelines with low latency and high availability
• Own the multimodal data pipeline layer—manage ingestion, processing, and serving of text, audio, and structured clinical data for ML and AI systems

AI Systems & Tooling

• Create reliable infrastructure for agentic AI systems, including orchestration, monitoring, evaluation, and observability tooling
• Build developer tooling that accelerates data science and ML engineering workflows across the organization

Observability & Operations

• Own AI observability—build monitoring, alerting, and debugging capabilities for production ML systems
• Partner with ML engineers, data scientists, and product teams to understand infrastructure needs and translate them into scalable platform capabilities
• Foster a culture of collaboration and learning across engineering, product, and design through mentoring, documentation, presentations, and knowledge sharing
• Participate in our on‑call rotation to ensure model serving uptime, pipeline reliability, and infrastructure health

Requirements

• 4+ years of professional experience in software engineering, with at least 2 years focused on ML infrastructure, ML platform, or AI systems engineering
• Strong software engineering fundamentals in Python and deep infrastructure expertise
• Familiarity with cloud ML services (AWS SageMaker, GCP Vertex AI, or similar) and CI/CD for ML pipelines
• Experience with infrastructure as code (Terraform, Pulumi, or similar) and container orchestration (Kubernetes, ECS)
• Experience building evaluation and observability systems for LLM‑based or agentic AI applications is a plus
• Excellent at managing ambiguity—able to break down big, messy problems into smaller parts with tractable solutions and clear iterations
• Growth mindset and sense of humor; you welcome feedback, adapt quickly in a fast‑paced environment, and foster a culture of learning and fun
• Experience with a systems language (Go, Rust, or C++) is a plus

This role requires 4 days per week in our NYC office (Flatiron District). The team is entirely based out of NYC.

Benefits

Charlie Health is pleased to offer comprehensive benefits to all full‑time, exempt employees. Read more about our benefits here.

The total target base compensation for this role will be between $170,000-$220,000 per year at the commencement of employment. Please note, pay will be determined on an individualized basis and will be impacted by location, experience, expertise, internal pay equity, and other relevant business considerations. Further, cash compensation is only part of the total compensation package, which, depending on the position, may include stock options and other Charlie Health‑sponsored benefits.

Our Values

• Connection: Care deeply & inspire hope.
• Congruence: Stay curious & heed the evidence.
• Commitment: Act with urgency & don’t give up.

Please do not call our public clinical admissions line in regard to this or any other job posting.

Please be cautious of potential recruitment fraud. If you are interested in exploring opportunities at Charlie Health, please go directly to our Careers Page: https://www.charliehealth.com/careers/current-openings. Charlie Health will never ask you to pay a fee or download software as part of the interview process with our company. In addition, Charlie Health will not ask for your personal banking information until you have signed an offer of employment and completed onboarding paperwork that is provided by our People Operations team. All communications with Charlie Health Talent and People Operations professionals will only be sent from @charliehealth.com email addresses. Legitimate emails will never originate from gmail.com, yahoo.com, or other commercial email services.

Recruiting agencies, please do not submit unsolicited referrals for this or any open role. We have a roster of agencies with whom we partner, and we will not pay any fee associated with unsolicited referrals.

At Charlie Health, we value being an Equal Opportunity Employer. We strive to cultivate an environment where individuals can be their authentic selves. Being an Equal Opportunity Employer means every member of our team feels as though they are supported and belong. We value diverse perspectives to help us provide essential mental health and substance use disorder treatments to all young people.

Charlie Health applicants are assessed solely on their qualifications for the role, without regard to disability or need for accommodation.

By clicking "Submit application" below, you agree to Charlie Health's Privacy Policy and Terms of Service.

By submitting your application, you agree to receive SMS messages from Charlie Health regarding your application. Message and data rates may apply. Message frequency varies. You can reply STOP to opt out at any time. For help, reply HELP.