Senior Engineer, Agentic AI Platform & Orchestration

Epiq; New York (NY); Hybrid; USD 195,000 - 255,000; Full time

Job summary

Epiq AI Labs is building the next‑generation AI platform for corporate legal departments and global law firms. You will own the orchestration runtime, retrieval layer agents, and evaluation infrastructure, delivering scalable systems from design to production.

Legal workflows demand correctness, confidentiality, and tenant isolation. The role emphasizes grounded retrieval, model‑ops, and multi‑tenant architecture while collaborating with security, product, and legal teams.

Qualifications

• 5+ years of software‑engineering experience with depth in backend, distributed, or AI systems.
• Demonstrated experience delivering and operating LLM‑based applications in production at scale.
• Experience with agentic architectures and orchestration frameworks.
• Experience with retrieval‑augmented generation systems at scale.
• Strong production‑level proficiency in Python.
• Experience evaluating agentic‑system accuracy and performance.
• Experience designing services and APIs used by other teams.
• Experience with observability tooling such as Prometheus, Grafana, or OpenTelemetry.
• Experience operating in containerized cloud environments.
• Strong system‑design and architecture experience with production docs.

Responsibilities

• Design the agentic platform used by other teams, including orchestration, tool registration and permissioning, durable state and memory, sandboxing, and trace‑level observability.
• Build agent workflows with multi‑step reasoning, tool use, human‑in‑the‑loop checkpoints, and recovery from partial failure during long‑running execution.
• Evaluate developments in model capabilities, agent‑design patterns, and evaluation practices, and translate them into platform architecture.
• Design retrieval‑augmented generation systems with hybrid search over legal corpora and citation grounding to specific sources.
• Build evaluation infrastructure, including golden datasets, regression harnesses, and offline and online evaluation loops.
• Establish model‑operations practices for routing, latency and cost budgets, prompt and context versioning, caching, and production reliability.
• Build scalable backend services and APIs; produce technical design documentation; partner with product, research, security, and legal domain experts.

Skills

Backend systems

Distributed systems

AI systems

LLM-based apps

Python

Observability

Containerized cloud

System design

Technical documentation

AI tooling

Tools

Python

Prometheus

Grafana

OpenTelemetry

Kubernetes

Docker

Azure

PostgreSQL

RabbitMQ

Qdrant

Solr

Job description

Epiq AI Labs is building the next‑generation AI platform for corporate legal departments and global law firms. You will own the orchestration runtime, retrieval layer agents, and evaluation infrastructure, delivering scalable systems from design to production.

Legal workflows demand correctness, confidentiality, and tenant isolation. The role emphasizes grounded retrieval, model‑ops, and multi‑tenant architecture while collaborating with security, product, and legal teams.