Senior AI Infra Engineer - Agent Orchestration

Castleisland; New York (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

Castleisland in New York, NY is seeking a skilled engineer to work on AI agent orchestration and infrastructure at scale. You'll orchestrate hundreds of agent runs, design engaging environments, and stay at the forefront of agent evaluation methodologies.

The ideal candidate has experience in container orchestration, distributed systems, and running LLM workloads efficiently under load. You'll work with a talented team and engage directly with AI researchers to innovate cutting-edge solutions.

Qualifications

• Experience with Kubernetes to manage container orchestration.
• Built or maintained message-driven systems like SQS, Kafka.
• Experience running LLM workloads under heavy load.

Responsibilities

• Monitor and manage agent orchestration at scale.
• Design realistic environments for agent evaluations.
• Support new integrations with external orchestration frameworks.

Skills

Container orchestration

Distributed systems

LLM infrastructure

Kubernetes

Message-driven architectures

Job description

Castleisland in New York, NY is seeking a skilled engineer to work on AI agent orchestration and infrastructure at scale. You'll orchestrate hundreds of agent runs, design engaging environments, and stay at the forefront of agent evaluation methodologies.

The ideal candidate has experience in container orchestration, distributed systems, and running LLM workloads efficiently under load. You'll work with a talented team and engage directly with AI researchers to innovate cutting-edge solutions.