Senior Platform Engineer AI Orchestration and Safety Remote

Stelloagents; Northern (KY); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Stello, an AI transformation firm, seeks a Senior Software Engineer for the Platform team to own orchestration, evaluations, observability, and safety guardrails for production agents. You’ll shape architecture, drive reliability, and raise the bar for engineering excellence, partnering with Forward Deployed Engineers to deploy scalable foundations for client work.

You will design long-running orchestration, build evaluation systems, and provide run traces, metrics, and alerts.

Qualifications

• 5+ years building production software that people depended on, and supporting it after launch.
• Sound judgment about architecture, testing, reliability, and maintainability.
• Experience with distributed systems, queues, or workflow engines.
• You have built with LLMs, and you can explain how you measured and improved their output.
• You use coding agents every day, and you know how to review and validate what they write.

Responsibilities

• Design and build orchestration for long-running, multi-step agents.
• Build the evaluation system that tells us if a change to a prompt, a model, or a tool made an agent better or worse.
• Give every agent run traces, metrics, and alerts, so we see a problem before a client does.
• Build controls: permissions, rate limits, human review steps, and safe ways to fail.
• Turn patterns from client work into components the delivery team can reuse.
• Make recommendations, explain your reasoning, and raise issues early when a plan needs to change.

Job description

Stello, an AI transformation firm, seeks a Senior Software Engineer for the Platform team to own orchestration, evaluations, observability, and safety guardrails for production agents. You’ll shape architecture, drive reliability, and raise the bar for engineering excellence, partnering with Forward Deployed Engineers to deploy scalable foundations for client work.

You will design long-running orchestration, build evaluation systems, and provide run traces, metrics, and alerts.