Senior Backend & Infra Engineer - AI Reliability Platform

Enboarder; New York (NY); On-site; USD 200,000 - 300,000; Full time

Job summary

Haize Labs is hiring a Staff+ Software Engineer, Backend and Infra in New York City. You will design and build scalable infrastructure to orchestrate tens of thousands of LLM calls per second, collaborate with research, and interface with customers to shape evaluation methodologies.

The role requires 7+ years of experience, 3+ years leading large initiatives, and strong cloud + distributed systems skills. In-person work six days a week in NYC with visa sponsorship for exceptional candidates.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical experience.
• 7+ years of industry experience, with 3+ years leading large initiatives.

Responsibilities

• Design and build scalable backend infrastructure and systems for AI reliability tooling.
• Collaborate with research to deploy new models and build user workflows.
• Mentor and lead technical direction across the organization.

Skills

Python

Go

Rust

Distributed systems

Cloud infrastructure

Leadership/mentoring

Education

Bachelor’s degree in CS/CE or equivalent

Tools

Kubernetes

Terraform

PostgreSQL

MongoDB

Redis

Job description

Haize Labs is hiring a Staff+ Software Engineer, Backend and Infra in New York City. You will design and build scalable infrastructure to orchestrate tens of thousands of LLM calls per second, collaborate with research, and interface with customers to shape evaluation methodologies.

The role requires 7+ years of experience, 3+ years leading large initiatives, and strong cloud + distributed systems skills. In-person work six days a week in NYC with visa sponsorship for exceptional candidates.