Senior Forward-Deployed AI Inference Engineer

Fdetimes

Toronto

Hybrid

CAD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Weekly lunch stipend
Health and dental benefits
RRSP matching / Pension
Parental leave top-up
Vacation days
Office stipend for remote workers

Job summary

Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise environments. You will own the architecture for complex inference challenges, enable low latency and high throughput, and drive adoption across multiple customers and datacenters.

You will work with cutting-edge hardware accelerators and advanced model serving topologies, ensuring robust production readiness and seamless

Qualifications

  • 8+ years in production infrastructure or distributed systems.
  • Experience with multi-cluster/kubernetes across cloud providers.
  • Strong understanding of LLM inference dynamics and performance.
  • Hands-on with inference engines and optimization stacks.
  • Proven customer-facing technical leadership.

Responsibilities

  • Embed with customer teams to connect AI models with production environments.
  • Design multi-tenant model serving topologies and cross-datacenter failover.
  • Optimize private deployments balancing SRE constraints with model performance.
  • Benchmark and profile LLM workloads; diagnose performance bottlenecks.
  • Accelerate hardware validation with GPUs, TPUs, or accelerators.
  • Translate field feedback into platform improvements and product features.
  • Ensure Day-1 production reliability and observable deployment patterns.

Skills

Distributed systems
Kubernetes multi-cluster
LLM architecture
Inference optimization
Python/Go/C++
Customer-facing leadership

Tools

vLLM
TensorRT-LLM
lmd
Dynamo

Job description

Cohere, a leading security-first enterprise AI company, is seeking a Staff Forward Deployed Engineer to architect and deploy high-performance AI models inside enterprise environments. You will own the architecture for complex inference challenges, enable low latency and high throughput, and drive adoption across multiple customers and datacenters.

You will work with cutting-edge hardware accelerators and advanced model serving topologies, ensuring robust production readiness and seamless

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Forward-Deployed AI Engineer: Enterprise Impact
Senior Forward-Deployed AI Engineer: Enterprise Impact

Accenture PLC • Toronto

On-site
CAD 142,000 - 292,000
Forward Deployed Engineer, Inference
Forward Deployed Engineer, Inference

FDE Times • Toronto

Hybrid
CAD 150,000 - 210,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / Pension
+3
Remote Senior Backend Architect — Enterprise AI Platform
Remote Senior Backend Architect — Enterprise AI Platform

Avenue.io Inc. • Toronto, Montreal

Remote
CAD 120,000 - 180,000
Lunch stipend
Health benefits
Parental leave top-up
+3
Engineering Manager, Agentic Deployments
Engineering Manager, Agentic Deployments

Avenue.io Inc. • Toronto

Hybrid
CAD 150,000 - 210,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Senior AI Forward Deployment Engineer — Hybrid
Senior AI Forward Deployment Engineer — Hybrid

Urban Ridge Supplies • Toronto

Hybrid
CAD 143,000 - 194,000
Hybrid work environment
Retirement savings plan with employer"
Company-provided benefits
+3
Senior Production AI Systems Engineer
Senior Production AI Systems Engineer

Cohere • Canada

Hybrid
CAD 140,000 - 210,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Public Sector AI Deployment Engineer
Public Sector AI Deployment Engineer

Urban Ridge Supplies • Toronto

Remote
CAD 175,000 - 385,000
Health and dental benefits
RRSP matching and pension
Parental leave
+3
Senior ML Infrastructure Engineer (Agentic AI)
Senior ML Infrastructure Engineer (Agentic AI)

Candidate • Toronto

Remote
CAD 120,000 - 170,000
Lunch stipend
Health benefits
RRSP matching / Pension
+5
Lead Forward-Deployed AI Engineer
Lead Forward-Deployed AI Engineer

Urban Ridge Supplies • Mississauga

Hybrid
CAD 120,000 - 180,000
Senior Full-Stack Engineer, Internal AI Tools
Senior Full-Stack Engineer, Internal AI Tools

Cohere • Toronto, Montreal

Hybrid
CAD 120,000 - 180,000
Lunch stipend
Health and dental benefits
RRSP matching
+5