Senior AI Platform Engineer — Scale AI Agents & Workflows

Epiq Company; Toronto; On-site; CAD 126,000 - 175,000; Full time

Job summary

Epiq in Toronto is seeking a Senior AI Platform Engineer to design and own the platform powering AI agents and accelerators. You will lead end-to-end development, mentor other engineers, and set technical direction across global teams.

This role focuses on scalable retrieval, model routing, observability, and cost-aware inference at production scale, with responsibilities spanning platform services, quality measurements, and governance to ensure secure, compliant workflows.

Qualifications

• Bachelor's or master’s degree in computer science or related field, or equivalent practical experience.
• 7+ years building production software with end-to-end ownership.
• Experience building production AI/LLM systems, including retrieval-augmented generation and agentic workflows.
• Strong Python.
• Comfortable in a TypeScript codebase.
• Experience with distributed systems and large batch data processing.
• Demonstrated ownership of production reliability: instrumentation, on-call, incident response, and data-driven decisions.
• Clear written communication to engineers and non-engineers.

Responsibilities

• Build and own platform capabilities for AI agents including orchestration and tool integration.
• Design retrieval systems across large-scale legal document collections.
• Develop shared platform services including prompt management, caching, rate limiting, and cost attribution.
• Define stable APIs and data contracts for product teams.
• Develop evaluation frameworks that measure accuracy, grounding, citation quality, and system performance.
• Build observability, tracing, and replay capabilities for rapid troubleshooting and continuous improvement.
• Establish quality gates and monitoring to identify regressions before they reach production.
• Collaborate with Product Management, legal domain experts, and Review Operations to turn ambiguous problems into shippable scope.

Skills

Python

TypeScript

Distributed systems

On-call

Documentation

Communication

Education

Bachelor's or master's in CS

Tools

PostgreSQL

LangGraph

LangChain

Langfuse

OpenTelemetry

React

Job description

Epiq in Toronto is seeking a Senior AI Platform Engineer to design and own the platform powering AI agents and accelerators. You will lead end-to-end development, mentor other engineers, and set technical direction across global teams.

This role focuses on scalable retrieval, model routing, observability, and cost-aware inference at production scale, with responsibilities spanning platform services, quality measurements, and governance to ensure secure, compliant workflows.