Infra Architect for AI Agents & Orchestration

Chakra Labs; New York (NY); On-site; USD 100,000 - 140,000; Full time

Job summary

A tech innovation company in New York is looking for a skilled professional to manage infrastructure for AI agents. The role involves orchestrating container environments, maintaining distributed systems, and ensuring LLM workloads run efficiently. Ideal candidates will have experience with Kubernetes, SQS, and Kafka, alongside a passion for working in a fast-paced, early-stage team environment. You will have the chance to collaborate with AI researchers directly and influence the future of agent technology.

Qualifications

• Experience with container orchestration tools in production environments.
• Knowledge of distributed systems and message-driven architectures.
• Experience in running LLM workloads at scale.

Responsibilities

• Manage agent orchestration and dispatch layer for AI workloads.
• Design environments and tasks for agent evaluation.
• Monitor and maintain model behavior and infrastructure.

Skills

Container orchestration

Distributed systems

LLM infrastructure

Debugging token throughput

Tools

Kubernetes

SQS

Kafka

Job description

A tech innovation company in New York is looking for a skilled professional to manage infrastructure for AI agents. The role involves orchestrating container environments, maintaining distributed systems, and ensuring LLM workloads run efficiently. Ideal candidates will have experience with Kubernetes, SQS, and Kafka, alongside a passion for working in a fast-paced, early-stage team environment. You will have the chance to collaborate with AI researchers directly and influence the future of agent technology.