Staff Software Engineer

Albert Bow; New York (NY); Hybrid; USD 170,000 - 210,000; Full time

Job summary

Albert Bow Limited is seeking a hands-on Staff Software Engineer to build and scale infrastructure behind enterprise AI agents in a hybrid NYC/Minneapolis setting. You will work across AI runtimes, memory systems, orchestration and secure execution to keep complex AI workflows production-ready.

The role covers distributed systems, platform engineering and solving challenging AI problems while mentoring engineers and driving architectural decisions.

Qualifications

• Strong Python and experience with TypeScript/Java/Go/Kotlin/Rust.
• Extensive backend, distributed systems and platform engineering experience.
• Experience building production LLM apps, AI agents or multi-step workflows.
• Knowledge of containers, cloud infrastructure, security and asynchronous systems.
• Proven technical leadership and architectural judgment.

Responsibilities

• Design and develop AI agent runtimes, reasoning loops and orchestration systems.
• Build agent memory, retrieval and context-management capabilities.
• Develop secure, isolated execution environments for AI agents.
• Implement tool integrations using MCP and related interfaces.
• Improve AI evaluation, observability, reliability and performance.
• Lead architectural decisions, mentor engineers and remain hands-on.

Skills

Python

TypeScript

Java

Go

Kotlin

Rust

Tools

Docker

Kubernetes

MCP

Job description

Location: New York City or Minneapolis, USA

Working Model: Hybrid – 3 days in-office

About the Role

We’re looking for a hands-on Staff Software Engineer to build and scale the infrastructure behind enterprise AI agents. You’ll work across AI agent runtimes, memory systems, orchestration and secure execution, ensuring complex AI workflows operate reliably in production.

This is an opportunity to solve challenging problems across applied AI, distributed systems and platform engineering.

Key Responsibilities

• Design and develop AI agent runtimes, reasoning loops and orchestration systems.
• Build agent memory, retrieval and context-management capabilities.
• Develop secure, isolated execution environments for AI agents.
• Implement tool integrations using MCP and related interfaces.
• Improve AI evaluation, observability, reliability and performance.
• Lead architectural decisions, mentor engineers and remain hands-on.

Requirements

• Strong Python skills and experience with TypeScript, Java, Go, Kotlin or Rust.
• Extensive backend, distributed systems and platform engineering experience.
• Experience building production LLM applications, AI agents or multi-step AI workflows.
• Knowledge of containers, cloud infrastructure, security and asynchronous systems.
• Proven technical leadership and strong architectural judgment.

Nice to have: Docker, Kubernetes, MCP, multi-agent systems, agent memory architectures and enterprise SaaS experience.