Senior Backend Engineer (ML)

Tennr; New York (NY); Hybrid; USD 170,000 - 230,000; Full time

Benefits offered by this job

Office at 345 Hudson Street

Unlimited PTO

100% paid employee health benefit

Employer-funded 401(k) match

Competitive parental leave

Free lunch

Pantry snacks

Job summary

Tennr is seeking a founding Sr. ML Infrastructure Engineer to own the infrastructure powering our AI-driven healthcare platform. You will design and scale cloud infrastructure for training, inference, and data pipelines, with a focus on reliability and observability.

We value strong system design fundamentals and offer a path to grow into ML infrastructure. This role is based in New York, NY with a hybrid on-site schedule at our Hudson Square office, four days per week.

Qualifications

• 4+ years building and scaling infrastructure in production-distributed systems, cloud platforms, or data engineering.
• Strong backend software engineering fundamentals; proficient in Python and TypeScript.
• Hands-on experience with AWS and PostgreSQL.
• Solid grasp of observability, reliability, and production incident response.
• Comfortable with ambiguity and high ownership; move fast in a startup.
• Interested in growing into ML infrastructure; prior ML ops/infra not required.
• Nice to have: exposure to inference engines (vLLM, SGLang, TensorRT) or k8s.

Responsibilities

• Architect, build, & scale the cloud infrastructure behind our ML training, inference, and data pipelines.
• Design resilient systems for model deployment, evaluation, and monitoring that stay reliable as traffic grows.
• Own observability across the stack - logging, metrics, tracing, and alerting.
• Troubleshoot production issues and continuously improve performance and efficiency.
• Collaborate with ML engineers, backend engineers, & cross-functional teams to integrate models cleanly with data pipelines and products.

Skills

Distributed infra

Python

TypeScript

Cloud platforms

Observability

Incident response

Tools

AWS

PostgreSQL

Kubernetes

Job description

Company Description

Today, when you go to your doctor and get referred to a specialist, your doctor sends out a referral and tells you, “They’ll be in touch soon.” So you wait. And wait. Sometimes days, weeks, or even months. Why? Because too often providers are overwhelmed with the painstakingly tedious work required to get paid by insurance companies. Powered by proprietary models, Tennr handles the complex paperwork that gets patients through the door and providers paid, helping operators get patients the right care, at the right time, in the right setting.

Role Description

We're looking for a founding Sr. ML Infrastructure Engineer with a strong background in distributed systems and building pipelines that scale. In this role, you’ll own the infrastructure that powers Tennr's AI-driven healthcare platform - the training, inference, and data pipelines that let our models handle growing traffic and an expanding product surface.

Our ML team builds in-house, proprietary VLMs, LLMs, and other models purpose-built for hard problems in healthcare. You don't need deep ML experience to thrive here - what matters is a strong system design foundation and the interest to grow into the ML-side. If you think in systems, care about reliability, and want to expand into ML infrastructure, this is a rare chance to build foundational systems from the ground up.

Responsibilities

• Architect, build, & scale the cloud infrastructure behind our ML training, inference, and data pipelines.
• Design resilient systems for model deployment, evaluation, and monitoring that stay reliable as traffic grows.
• Own observability across the stack - logging, metrics, tracing, and alerting.
• Troubleshoot production issues and continuously improve performance and efficiency.
• Collaborate with ML engineers, backend engineers, & cross-functional teams to integrate models cleanly with data pipelines and products.

Candidate Qualifications

• 4+ years building & scaling infrastructure in production-distributed systems, cloud platforms, or data engineering.
• Strong backend software engineering fundamentals, with proficiency in Python & TypeScript.
• Hands-on experience with AWS, & PostgreSQL.
• Solid grasp of observability, reliability, and production incident response.
• Comfortable with ambiguity & high ownership; you move fast and drive projects from idea to production in a startup environment.
• Interested in growing into ML infrastructure - prior ML ops/infra experience is not required.
• Nice to have: exposure to inference engines (vLLM, SGLang, TensorRT), or k8s.

Why Tennr?

• Drive Impact: one of our company values is Cowboy, meaning you set the pace. You won’t just talk about things, you’ll get them done. And feel the impact.
• Develop Operational Expertise: learn the inner workings of scaling systems, tools, and infrastructure.
• Innovate with Purpose: we’re not just doing this for fun (although we do have a lot of fun). At Tennr, you’ll join a high-caliber team maniacally focused on reducing patient delays across the U.S. healthcare system.
• Build Relationships: collaborate and connect with like-minded, driven individuals in our Hudson Square office 4 days/week.
• Free lunch! Plus a pantry full of snacks.

Benefits

• Beautiful new office at 345 Hudson Street
• Unlimited PTO
• 100% paid employee health benefit options
• Employer-funded 401(k) match
• Competitive parental leave