3033 | Haize Labs | Staff+ Backend/Infra Software Engineer

Recruiting From Scratch; New York (NY); On-site; USD 225,000 - 480,000; Full time

Job summary

A premier talent firm seeks a Senior Backend & Infrastructure Engineer for a Series A AI startup in NYC. You'll design scalable systems, collaborate with researchers, and shape AI reliability solutions. Ideal candidates have extensive software engineering experience, particularly in cloud and backend technologies.

Benefits

Competitive equity

Visa sponsorship available

Work alongside top engineers

Qualifications

• 7+ years of experience as a software engineer.
• Demonstrated success in building distributed backend systems.
• Experience in early-stage B2B SaaS environments.

Responsibilities

• Design and implement scalable systems orchestrating LLM operations.
• Collaborate on deploying AI models and reliability tooling.
• Contribute to architectural direction and mentor engineers.

Skills

Backend language proficiency

Cloud platforms knowledge

Database knowledge

Problem-solving mindset

Communication skills

Tools

AWS

Kubernetes

Terraform

Postgres

MongoDB

Redis

Job description

Who is Recruiting from Scratch:

Recruiting from Scratch is a premier talent firm that focuses on placing the best product managers, software, and hardware talent at innovative companies. Our team is 100% remote and we work with teams across the United States to help them hire.

Title of Role: Senior Backend & Infrastructure Engineer

Location: New York City (In-Person, Flatiron)
Company Stage of Funding: Series A
Office Type: Onsite 5 Days a Week
Salary: $225,000 – $480,000 + Competitive Equity

Company Description

Our client is a Series A, VC-backed AI infrastructure startup building a platform to bring AI-based applications from proof-of-concept to production. Their mission is to improve the reliability and safety of large language model (LLM) applications through advanced testing, guardrails, and evaluation frameworks.

The company is already working with top-tier customers — from leading AI labs to enterprise-scale businesses — to ensure their AI systems are robust, trustworthy, and ready for real-world deployment. With a seasoned founding team and strong technical advisory board, this is an exciting opportunity to join early and shape the future of AI reliability tooling.

What You Will Do

• Design and implement scalable systems that orchestrate thousands of LLM operations per second (e.g., evaluations, red-teaming, runtime guardrails)

• Collaborate with researchers to deploy novel AI models and build cutting-edge reliability tooling

• Interface with customers to refine the platform’s capabilities and improve developer workflows

• Contribute to architectural direction and mentor a growing team of engineers

• Establish best practices that enable operational excellence across engineering

Ideal Candidate Background

• 7+ years of experience as a software engineer, including at least 3 years leading large initiatives as an engineer or manager

• Demonstrated success in building and scaling complex distributed backend systems

• Previous work in early-stage or 0→1 product environments, ideally B2B SaaS

• Exposure to applied AI/ML workflows and collaboration with research/ML teams

• Experience with cloud-native infrastructure in production environments

Preferred

• Familiarity with LLMs, model evaluations, or applied AI testing

• Expertise in security, privacy, or compliance in cloud environments

• Experience building or operating GPU-based model infrastructure

• Contributions to open-source infrastructure or developer tooling projects

Must Haves

• Strong proficiency in at least one backend language (e.g., Python, Go, Rust)

• Deep knowledge of cloud platforms (AWS, GCP, or Azure), Kubernetes, Terraform

• Strong understanding of relational and NoSQL databases (e.g., Postgres, MongoDB, Redis)

• Practical, outcomes-oriented mindset with ability to solve ambiguous problems

• Strong communication and collaboration skills

Compensation, Benefits & Other Details

• Base Salary: $225,000 – $480,000

• Equity: Competitive stock options package

• Work Location: In-person, Flatiron (NYC HQ)

• Visa Sponsorship: Available for exceptional candidates

• Team Size: <10, working alongside engineers from top academic and industry backgrounds

• Tech Stack: Python, FastAPI, Kubernetes, Terraform, Postgres, MongoDB, Redis, AWS, React, TypeScript

This is a rare opportunity to shape the infrastructure powering the next generation of safe, production-ready AI applications. If you thrive in fast-paced, mission-driven environments and want to build something foundational in AI, we’d love to hear from you.