Staff Software Engineer: AI Agents & Distributed Systems (Hybrid)

Datasite; New York (NY); Hybrid; USD 170,000 - 297,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

Paid time off

Employee benefits

Job summary

Datasite is seeking a hands-on Staff Software Engineer to shape the foundational infrastructure for enterprise AI agents in New York City or Minneapolis. You will evolve our custom agent harness, design memory layers, and architect secure, isolated execution environments for robust, production-scale agent workflows.

The role emphasizes distributed systems, security, and platform engineering, collaborating across Engineering, Product, ML, and Security to deliver high-impact capabilities for

Qualifications

• Experience building and operating production software.
• Ability to lead complex technical initiatives across teams.
• Strong backend and distributed systems expertise.

Responsibilities

• Lead the architecture and evolution of Datasite's custom agent harness, including reasoning and execution loops, planning, tool selection, state transitions, structured outputs, and runtime controls.
• Design layered agent memory spanning working context, episodic history, semantic knowledge, and durable workflow state; build retrieval, consolidation, and access controls.
• Architect isolated, containerized agent execution environments with secure credential handling.
• Build resilient agent orchestration: asynchronous tasks, subagents, delegation, checkpoints, and retries.
• Create secure, extensible tool integrations with proper permissions and safeguards.
• Establish evaluation, tracing, observability, and regression testing to measure quality and cost.
• Make high-impact tradeoffs between probabilistic model behavior and deterministic logic and human review.
• Partner with Product, ML, Security, and platform teams to productionize agent experiences; mentor engineers.

Skills

Distributed systems

Backend platforms

Python

Architecture design

Mentoring

Communication

Cloud-native

Security

Tools

Python

TypeScript

Java

Go

Kubernetes

Docker

Rust

Job description

Datasite is seeking a hands-on Staff Software Engineer to shape the foundational infrastructure for enterprise AI agents in New York City or Minneapolis. You will evolve our custom agent harness, design memory layers, and architect secure, isolated execution environments for robust, production-scale agent workflows.

The role emphasizes distributed systems, security, and platform engineering, collaborating across Engineering, Product, ML, and Security to deliver high-impact capabilities for