Senior AI Platform Engineer — Distributed Systems & LLMs

SIDRAM TECHNOLOGIES; New York (NY); Hybrid; USD 190,000 - 240,000; Full time

Job summary

SIDRAM TECHNOLOGIES is seeking a Senior AI / Agent Platform Engineer in New York, NY. The role focuses on building scalable runtime services and distributed systems to power enterprise AI agent capabilities in production environments.

The candidate will design and implement long-running workflows, routing models, and multi-LLM integrations while collaborating with security and platform teams. Hybrid onsite schedule applies, with high demand for senior leadership and PMP-certified professionals.

Qualifications

• 15+ years of Software Engineering experience required.
• Strong distributed systems and system design background.
• Production experience with LLMs, AI agents, function calling and workflow orchestration.
• Runtime services for long-running and asynchronous AI workloads.
• Model routing and LLM abstraction layers.
• Multi-LLM provider integration.
• Tool invocation and execution state management.
• Retries, checkpointing and failure recovery.

Skills

15+ years

Distributed Systems

LLMs & Agents

Async AI workloads

Model Routing

Observability

Cloud-Native

Security & Identity

Tools

Kubernetes

Containers

APIs & SDKs

Job description

SIDRAM TECHNOLOGIES is seeking a Senior AI / Agent Platform Engineer in New York, NY. The role focuses on building scalable runtime services and distributed systems to power enterprise AI agent capabilities in production environments.

The candidate will design and implement long-running workflows, routing models, and multi-LLM integrations while collaborating with security and platform teams. Hybrid onsite schedule applies, with high demand for senior leadership and PMP-certified professionals.