Senior AI Engineer — Production Agentic Systems (Onsite)

Apolis; New York (NY); On-site; USD 140,000 - 152,000; Full time

Job summary

Apolis is seeking a Senior AI Engineer to build and scale production agentic workflows. You will own end-to-end orchestration, integrating with Java/Spring services and existing APIs in a high-trust environment.

You will design inference and serving components, perform evaluation, and ensure robust guardrails and observability across distributed systems in a regulated industry setting.

Qualifications

• 7+ years in software engineering with ownership of production systems.
• Proven delivery of LLM-based agentic systems in production.
• Strong Python and Java proficiency used daily.
• Experience with LangChain/LangGraph and RAG pipelines.
• Familiarity with model serving and inference (vLLM, OpenAI).
• Solid distributed systems fundamentals (APIs, queues, CI/CD).

Responsibilities

• Design and build production agentic workflows for multi-turn conversations.
• Own agent orchestration end-to-end using LangGraph/LangChain, incl. guardrails.
• Integrate agents with core service layer: Java/Spring microservices and APIs.
• Build and tune evaluation loops: automated evals, regressions, traces.
• Work on inference/serving: model routing and self-hosted serving with vLLM.
• Harden systems for regulated environments: PII handling, auditability, observability.

Skills

Python

Java

LLM‑based agent systems

Distributed systems

LangChain/LangGraph

Tools

LangChain

LangGraph

vLLM

PyTorch

OpenAI API

Job description

Apolis is seeking a Senior AI Engineer to build and scale production agentic workflows. You will own end-to-end orchestration, integrating with Java/Spring services and existing APIs in a high-trust environment.

You will design inference and serving components, perform evaluation, and ensure robust guardrails and observability across distributed systems in a regulated industry setting.