Staff AI Infrastructure Engineer: Own the Intelligence Layer

Cassi Home

United States

On-site

USD 180,000 - 260,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cassi Home seeks a Staff- or Principal-level AI Infrastructure Engineer to own the intelligence layer end-to-end—from the agent runtime to the multi-provider inference substrate and surfaces that touch users. This role drives architectural decisions, audits existing choices, and leads migrations to scale the platform with reliable, observable systems.

You will own graph topology, tool-call correctness, streaming, memory, and per-property memory across interactions, while ensuring secure,

Qualifications

  • 8+ years of professional backend engineering.
  • Roughly 3–5 years working directly with LLMs.
  • Production experience, not demos.
  • Agent and tool-calling depth.
  • Inference fundamentals and streaming.
  • Retrieval judgment for embeddings and memory.
  • Evaluation discipline and offline/online evals.
  • Security instinct for AI surfaces.
  • Judgment about other people's architecture.
  • Backend depth with DDD or event-driven design.

Responsibilities

  • Architectural Audit & Scale: pressure-test and migrate existing design choices.
  • Agent Runtime & Orchestration: manage graph topology, tool calls, state, and failures.
  • Inference Infrastructure & Model Routing: provider-agnostic substrate and routing.
  • Realtime Voice: manage bidirectional streaming, latency, and billing units.
  • Retrieval, Context & Memory: embedding strategy and per-property memory.
  • Ambient Intelligence & Evaluators: event-driven signals and evaluators.
  • Evaluation, Observability & Unit Economics: tracing, cost attribution, QA gates.
  • Productization — In-Product and Internal: ship surfaces behind feature gates.

Skills

TypeScript mastery
Backend depth
Database fluency
AWS
Security & reliability

Education

Bachelor's degree in Computer Science or related field

Tools

AWS
DynamoDB
PostgreSQL
LangGraph-like frameworks

Job description

Cassi Home seeks a Staff- or Principal-level AI Infrastructure Engineer to own the intelligence layer end-to-end—from the agent runtime to the multi-provider inference substrate and surfaces that touch users. This role drives architectural decisions, audits existing choices, and leads migrations to scale the platform with reliable, observable systems.

You will own graph topology, tool-call correctness, streaming, memory, and per-property memory across interactions, while ensuring secure,

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Engineer - Agentic Platform
Senior AI Infrastructure Engineer - Agentic Platform

Zoomcar • Town of Poland (NY)

Hybrid
Career development
Extra vacation days
Office in Warsaw
+3
Chief AI Platform & Infra Architect
Chief AI Platform & Infra Architect

interface.ai • San Francisco (CA)

On-site
USD 400,000 - 500,000
Executive compensation
Staff AI Engineer — Production-Grade AI for CPA Apps
Staff AI Engineer — Production-Grade AI for CPA Apps

uiAgent • New York (NY)

On-site
USD 180,000 - 260,000
Equity stake
Competitive salary + bonus
Flat structure – work directly with co
+4
Staff AI Engineer: Enterprise Platform Architect
Staff AI Engineer: Enterprise Platform Architect

Cerebras • Sunnyvale (CA)

On-site
USD 180,000 - 240,000
Staff AI Platform Engineer: Architect Production Agent Systems
Staff AI Platform Engineer: Architect Production Agent Systems

Sapiom • San Francisco (CA)

On-site
USD 180,000 - 260,000
Engineering Manager, AI Infrastructure & Platform
Engineering Manager, AI Infrastructure & Platform

assorthealth • United States

On-site
USD 150,000 - 230,000
Competitive compensation package with股
Lifelong learning budget
Office setup stipend
+6
Staff AI Engineer - Architect of AI-Native Platforms
Staff AI Engineer - Architect of AI-Native Platforms

Empathy Talent • San Francisco (CA)

On-site
USD 186,000 - 310,000
401(k) plan
Wellness benefits
Technology reimbursements
+2
Staff Engineer: AI Infrastructure & Scale Leader
Staff Engineer: AI Infrastructure & Scale Leader

Recruiting From Scratch • San Francisco (CA)

On-site
USD 250,000 - 300,000
Competitive equity
Ownership in infra
Direct collaboration with founders
+1
Staff AI Engineer: Enterprise Systems & Automation
Staff AI Engineer: Enterprise Systems & Automation

Cerebras • United States

Remote
USD 170,000 - 210,000
Staff AI Platform Architect & Fullstack Leader
Staff AI Platform Architect & Fullstack Leader

Scale AI, Inc. • New York (NY)

On-site
USD 252,000 - 315,000
Equity
Health benefits
PTO
+2