Staff Software Engineer — AI Agent Infra & Orchestration

Albert Bow

New York (NY)

Hybrid

USD 170,000 - 210,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Albert Bow Limited is seeking a hands-on Staff Software Engineer to build and scale infrastructure behind enterprise AI agents in a hybrid NYC/Minneapolis setting. You will work across AI runtimes, memory systems, orchestration and secure execution to keep complex AI workflows production-ready.

The role covers distributed systems, platform engineering and solving challenging AI problems while mentoring engineers and driving architectural decisions.

Qualifications

  • Strong Python and experience with TypeScript/Java/Go/Kotlin/Rust.
  • Extensive backend, distributed systems and platform engineering experience.
  • Experience building production LLM apps, AI agents or multi-step workflows.
  • Knowledge of containers, cloud infrastructure, security and asynchronous systems.
  • Proven technical leadership and architectural judgment.

Responsibilities

  • Design and develop AI agent runtimes, reasoning loops and orchestration systems.
  • Build agent memory, retrieval and context-management capabilities.
  • Develop secure, isolated execution environments for AI agents.
  • Implement tool integrations using MCP and related interfaces.
  • Improve AI evaluation, observability, reliability and performance.
  • Lead architectural decisions, mentor engineers and remain hands-on.

Skills

Python
TypeScript
Java
Go
Kotlin
Rust

Tools

Docker
Kubernetes
MCP

Job description

Albert Bow Limited is seeking a hands-on Staff Software Engineer to build and scale infrastructure behind enterprise AI agents in a hybrid NYC/Minneapolis setting. You will work across AI runtimes, memory systems, orchestration and secure execution to keep complex AI workflows production-ready.

The role covers distributed systems, platform engineering and solving challenging AI problems while mentoring engineers and driving architectural decisions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer: AI Agents & Distributed Systems (Hybrid)
Staff Software Engineer: AI Agents & Distributed Systems (Hybrid)

Datasite • New York (NY)

Hybrid
USD 170,000 - 297,000
Health insurance
Retirement plan
Paid time off
+1
Staff Software Engineer
Staff Software Engineer

Albert Bow • New York (NY)

Hybrid
USD 170,000 - 210,000
Staff Software Engineer: AI Agent Infra, Hybrid
Staff Software Engineer: AI Agent Infra, Hybrid

Perot Jain • Minneapolis (MN)

Hybrid
USD 170,000 - 297,000
Health insurance
Retirement savings plan
Paid time off
Senior AI Platform Engineer - Production Agents & Pipelines
Senior AI Platform Engineer - Production Agents & Pipelines

Collaboration.Ai • United States

Remote
USD 180,000 - 240,000
Staff Software Architect — AI-Driven, Scalable Platforms
Staff Software Architect — AI-Driven, Scalable Platforms

Datasite • New York (NY)

Hybrid
USD 170,000 - 297,000
Health insurance (medical)
Retirement savings plan
Paid time off
Senior AI Infra Engineer - Agent Orchestration
Senior AI Infra Engineer - Agent Orchestration

Castleisland • New York (NY)

On-site
USD 120,000 - 150,000
Senior AI Backend Engineer – Enterprise-Scale Orchestration
Senior AI Backend Engineer – Enterprise-Scale Orchestration

Klarity • San Francisco (CA)

On-site
USD 220,000 - 280,000
Equity
Employer-Paid Medical
Parental Leave
+4
Backend Engineer - AI & APIs for Finance (Hybrid NYC)
Backend Engineer - AI & APIs for Finance (Hybrid NYC)

Albert Bow Limited • New York (NY)

Hybrid
USD 160,000 - 220,000
Full benefits
Hybrid work model
Senior AI Agents Engineer (Remote • Equity)
Senior AI Agents Engineer (Remote • Equity)

People in AI • United States

Remote
USD 200,000 - 275,000
Staff Software Engineer - AI Agent Infra (Hybrid, Equity)
Staff Software Engineer - AI Agent Infra (Hybrid, Equity)

ContentBuffer • San Francisco (CA)

Hybrid
USD 208,000 - 365,000
Equity