Senior AI Engineer — Agentic Systems

Apolis; New York (NY); On-site; USD 140,000 - 152,000; Full time

Job summary

Apolis is seeking a Senior AI Engineer to build and scale production agentic workflows. You will own end-to-end orchestration, integrating with Java/Spring services and existing APIs in a high-trust environment.

You will design inference and serving components, perform evaluation, and ensure robust guardrails and observability across distributed systems in a regulated industry setting.

Qualifications

• 7+ years in software engineering with ownership of production systems.
• Proven delivery of LLM-based agentic systems in production.
• Strong Python and Java proficiency used daily.
• Experience with LangChain/LangGraph and RAG pipelines.
• Familiarity with model serving and inference (vLLM, OpenAI).
• Solid distributed systems fundamentals (APIs, queues, CI/CD).

Responsibilities

• Design and build production agentic workflows for multi-turn conversations.
• Own agent orchestration end-to-end using LangGraph/LangChain, incl. guardrails.
• Integrate agents with core service layer: Java/Spring microservices and APIs.
• Build and tune evaluation loops: automated evals, regressions, traces.
• Work on inference/serving: model routing and self-hosted serving with vLLM.
• Harden systems for regulated environments: PII handling, auditability, observability.

Skills

Python

Java

LLM‑based agent systems

Distributed systems

LangChain/LangGraph

Tools

LangChain

LangGraph

vLLM

PyTorch

OpenAI API

Job description

Role:Senior AI Engineer — Agentic Systems
Location: 5 days onsite - Plano, NY/NJ, Columbus
Duration: 12+ Months
Pay rate: $70/hr. on w2

The Opportunity

We are a technology organization operating at the scale of a major financial enterprise — and we are building AI agents that serve millions of customers directly. This is not a chatbot bolt-on or an innovation-lab experiment: our agentic platform sits in the production path of real customer conversations, with the reliability, latency, and safety bar that implies.

We're engaging senior engineers who have actually shipped agentic systems — people who have felt the difference between a demo that works and an agent that survives contact with real users. You'll join a small, senior team moving at startup pace with enterprise-scale distribution.

What You'll Do

• Design and build production agentic workflows for customer-facing use cases — multi-turn conversation, tool calling, retrieval, escalation, and human handoff.
• Own agent orchestration end to end using LangGraph/LangChain (or equivalent frameworks), including state management, guardrails, and failure recovery.
• Integrate agents with our core service layer: existing Java/Spring microservices, APIs, and event streams are the hands and feet of every agent you build.
• Build and tune the evaluation loop — automated evals, regression suites, trace analysis, and A/B measurement of agent quality.
• Work on the inference and serving layer: model routing, prompt/context management, and self-hosted serving with vLLM alongside commercial LLM APIs.
• Harden everything for a regulated, high-trust environment: PII handling, auditability, deterministic fallbacks, and observability.

Must-Have Qualifications

• 7+ years of software engineering experience, with senior/lead-level ownership of production systems.
• Proven hands‑on delivery of LLM-based agentic systems in production — not coursework, not POCs. Expect to walk us through architecture, failure modes, and eval strategy of something you shipped.
• Strong Python (primary agent/ML stack) and Java (service integration) — both are daily‑use languages here.
• Depth in the standard agent stack: LangChain, LangGraph, prompt/context engineering, tool/function calling, RAG pipelines.
• Working knowledge of PyTorch and model fundamentals — enough to fine‑tune, debug model behavior, and reason about tradeoffs.
• Experience with LLM serving/inference — vLLM or comparable (TGI, TensorRT‑LLM), plus commercial APIs (OpenAI, Anthropic, Bedrock/Vertex).
• Solid distributed‑systems fundamentals: APIs, queues, caching, observability, CI/CD.

Major Plus

• Hands‑on experience with agent‑builder platforms such as Sierra or Decagon — deploying, extending, or evaluating them for customer‑service use cases.
• Voice agents, real‑time/streaming inference, or contact‑center integration.
• Experience in regulated industries (finance, healthcare) — model risk, compliance review, audit trails.
• Eval frameworks (LangSmith, Braintrust, custom harnesses) and LLM safety/guardrail tooling.