Senior AI Platform Engineer (Agentic)

Epiq Company; New York (NY); Hybrid; USD 195,000 - 255,000; Full time

Job summary

Epiq, a global leader in legal technology, seeks an AI/Backend engineer for Epiq AI Labs in New York. The role is hybrid, requiring 3–4 days in the office weekly, with a fast-paced, startup-like team backed by a global organization.

You will design agent platforms, retrieval-augmented generation pipelines, and scalable services. Collaborate with product, research, security, and legal experts to deliver end-to-end solutions using Python and modern AI tooling.

Qualifications

• 5+ years of software-engineering experience.
• Experience delivering and operating LLM-based applications in production at scale.
• Experience with agentic architectures and orchestration frameworks.
• Experience with retrieval-augmented generation systems at scale.
• Strong production-level proficiency in Python.
• Experience evaluating agentic-system accuracy and performance.
• Experience designing services and APIs consumed by other engineering teams.
• Experience with observability tooling such as Prometheus, Grafana, or OpenTelemetry.
• Experience operating in containerized cloud environments.
• Strong system-design and architecture experience, including production of technical design documents.
• Excellent written and verbal communication, including ability to work with non-technical stakeholders.
• Demonstrated proficiency using AI tools in software development.

Responsibilities

• Design the agentic platform used by other teams, including orchestration, tool registration and permissioning, durable state and memory, sandboxing, and trace-level observability.
• Build agent workflows with multi-step reasoning, tool use, human-in-the-loop checkpoints, and recovery from partial failure during long-running execution.
• Evaluate developments in model capabilities, agent-design patterns, and evaluation practices, and translate them into platform architecture.
• Design retrieval-augmented generation systems with hybrid search over legal corpora and citation grounding to specific sources.
• Build evaluation infrastructure, including golden datasets, regression harnesses, and offline and online evaluation loops.
• Establish model-operations practices for routing, latency and cost budgets, prompt and context versioning, caching, and production reliability.
• Build scalable backend services and APIs; produce technical design documentation; partner with product, research, security, and legal domain experts; and strengthen engineering standards.

Skills

Python

LLM-based apps

Agentic architectures

Retrieval-augmented generation

Distributed systems

Communication skills

Tools

Prometheus

Grafana

OpenTelemetry

Kubernetes

Docker

Azure

PostgreSQL

RabbitMQ

Qdrant

Solr

Job description

Epiq, a global leader in legal technology, seeks an AI/Backend engineer for Epiq AI Labs in New York. The role is hybrid, requiring 3–4 days in the office weekly, with a fast-paced, startup-like team backed by a global organization.

You will design agent platforms, retrieval-augmented generation pipelines, and scalable services. Collaborate with product, research, security, and legal experts to deliver end-to-end solutions using Python and modern AI tooling.