Backend Engineer, AI (Agent Systems)

Sarsfield Group; Canada; On-site; CAD 90,000 - 150,000; Full time

Job summary

Sarsfield Group is seeking a Backend Engineer, AI, who will own the inference and orchestration layer powering AI interactions in the product. You will build and operate production systems that turn model capability into fast, stable APIs used across mobile and desktop clients.

You will design inference pipelines, manage monitoring and incident response, and optimize latency and throughput for inference, caching, batching, and streaming.

Qualifications

• Experience running high-throughput, low-latency services.
• Familiarity with AI inference patterns (LLMs, embeddings, multimodal).
• Bias toward shipping and learning from production behavior.

Responsibilities

• Build and operate backend systems that serve AI-powered features in production.
• Design inference pipelines, orchestration layers, and service boundaries around models.
• Own production concerns: monitoring, logging, alerting, and incident response.
• Optimize latency and throughput across inference, caching, batching, and streaming.

Skills

Low-latency services

AI inference patterns

Production APIs

API design

Tools

Docker

PyTorch

OpenAI API

Anthropic API

SQL

NoSQL

Job description

There are over 5 billion users using basic applications today such email, notes, tasks, calendar and they’re not AI-native. Our client’s mission is to build proactive applications for anyone in the world, who are not used to complex prompting. They aim to bring intelligence to conversations, errands, organising and workflows, with minimal to no prompting.

Their product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. They believe products will greatly reduce hallucinations.

Their objective is to organise anyone’s life, allowing us all to spend time on valuable and meaningful things.

Role

As a Backend Engineer, AI, you own the inference and orchestration layer that powers every AI interaction in the product. Your work sits between models and users, where latency, correctness, reliability, and cost directly impact real-world experience.

You will build and operate production systems that turn model capability into fast, stable, observable APIs used across mobile and desktop clients.

Focus

Build and operate backend systems that serve AI-powered features in production.

Design inference pipelines, orchestration layers, and service boundaries around models.

Own production concerns: monitoring, logging, alerting, and incident response.

Optimize latency and throughput across inference, caching, batching, and streaming.

Ideal Experiences

Experience running high-throughput, low-latency services.

Familiarity with AI inference patterns (LLMs, embeddings, multimodal).

Bias toward shipping and learning from production behavior.

Outcomes

Backend systems run reliably at scale, handling production AI traffic with low latency and high throughput.

APIs are stable, clear, and support seamless integration with frontend and ML systems.

Production incidents are quickly detected, diagnosed, and resolved, minimizing user impact.

Iterative improvements based on real usage continuously increase system performance and reliability.

Python

NodeJs

Pytorch

OpenAI / Anthropic / open-source LLMs

SQL & noSQL

Docker

How We Work

The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product

If there appears to be a fit, we’ll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you’ve demonstrated the exceptional skills and mindset we’re looking for, we’ll extend an offer to join us. This isn’t just a job offer; it’s an invitation to be part of a team that’s bringing AI to have practical benefits to billions globally.

We appreciate every application we receive. Due to the volume of interest, only candidates selected for an interview will be contacted.