Founding Senior ML Infrastructure Engineer

Tennr; New York (NY); Hybrid; USD 170,000 - 230,000; Full time

Benefits offered by this job

Office at 345 Hudson Street

Unlimited PTO

100% paid employee health benefit

Employer-funded 401(k) match

Competitive parental leave

Free lunch

Pantry snacks

Job summary

Tennr is seeking a founding Sr. ML Infrastructure Engineer to own the infrastructure powering our AI-driven healthcare platform. You will design and scale cloud infrastructure for training, inference, and data pipelines, with a focus on reliability and observability.

We value strong system design fundamentals and offer a path to grow into ML infrastructure. This role is based in New York, NY with a hybrid on-site schedule at our Hudson Square office, four days per week.

Qualifications

• 4+ years building and scaling infrastructure in production-distributed systems, cloud platforms, or data engineering.
• Strong backend software engineering fundamentals; proficient in Python and TypeScript.
• Hands-on experience with AWS and PostgreSQL.
• Solid grasp of observability, reliability, and production incident response.
• Comfortable with ambiguity and high ownership; move fast in a startup.
• Interested in growing into ML infrastructure; prior ML ops/infra not required.
• Nice to have: exposure to inference engines (vLLM, SGLang, TensorRT) or k8s.

Responsibilities

• Architect, build, & scale the cloud infrastructure behind our ML training, inference, and data pipelines.
• Design resilient systems for model deployment, evaluation, and monitoring that stay reliable as traffic grows.
• Own observability across the stack - logging, metrics, tracing, and alerting.
• Troubleshoot production issues and continuously improve performance and efficiency.
• Collaborate with ML engineers, backend engineers, & cross-functional teams to integrate models cleanly with data pipelines and products.

Skills

Distributed infra

Python

TypeScript

Cloud platforms

Observability

Incident response

Tools

AWS

PostgreSQL

Kubernetes

Job description

Tennr is seeking a founding Sr. ML Infrastructure Engineer to own the infrastructure powering our AI-driven healthcare platform. You will design and scale cloud infrastructure for training, inference, and data pipelines, with a focus on reliability and observability.

We value strong system design fundamentals and offer a path to grow into ML infrastructure. This role is based in New York, NY with a hybrid on-site schedule at our Hudson Square office, four days per week.