Remote Senior Backend Architect — Enterprise AI Platform

Avenue.io Inc.

Toronto, Montreal

Remote

CAD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Lunch stipend
Health benefits
Parental leave top-up
Annual enrichment benefits
Vacation and travel budget
Home office stipend

Job summary

Cohere is seeking a highly experienced Back-End Software Engineer to help shape the Model Vault platform. You will own architecture for reliable, secure, and scalable backend systems that connect customers to enterprise AI inference at scale.

You’ll lead critical initiatives across identity, billing, and deployment systems, collaborating with security-focused teams to deliver robust, production-grade solutions.

Qualifications

  • Strong backend engineer with fundamentals in distributed systems, databases, networking, OS, and security.
  • Experience building production systems in Go, Python, Java, C++, Rust or similar.
  • Designed and operated production systems with emphasis on correctness, availability, security, and performance.

Responsibilities

  • Evolve and scale backend systems powering Model Vault, including auth, deployment management, billing, metering, and customer lifecycle.
  • Lead architectural initiatives across identity, payments, usage, scalability, and core foundations.
  • Build reliable control-plane services for provisioning, configuring, and operating deployments across clouds/hardware.
  • Design APIs and distributed systems with guarantees around correctness, isolation, failure recovery, idempotency, and observability.
  • Incorporate security and privacy into platform architecture, including tenant isolation, secrets management, encryption, and confidential computing boundaries.
  • Tackle complex problems spanning backend systems, cloud infra, security, and AI inference when SaaS patterns fall short.
  • Drive projects end-to-end from architecture and threat modeling to rollout and production operations.

Skills

Distributed systems
Go
Python
Java
C++
Rust
Security
API design
Cloud infrastructure
Debugging

Job description

Cohere is seeking a highly experienced Back-End Software Engineer to help shape the Model Vault platform. You will own architecture for reliable, secure, and scalable backend systems that connect customers to enterprise AI inference at scale.

You’ll lead critical initiatives across identity, billing, and deployment systems, collaborating with security-focused teams to deliver robust, production-grade solutions.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior/Staff Backend Software Engineer (Inference)
Senior/Staff Backend Software Engineer (Inference)

Cohere • Canada

Remote
CAD 110,000 - 170,000
Equity / stock options
Six weeks’ paid vacation
RRSP, 401(k), and Pension Scheme
+4
Senior/Staff Software Engineer (Back-End), Inference
Senior/Staff Software Engineer (Back-End), Inference

FDE Times • Toronto, Montreal

Hybrid
CAD 140,000 - 210,000
Lunch stipend
Health benefits
RRSP matching
+5
Senior Forward-Deployed AI Inference Engineer
Senior Forward-Deployed AI Inference Engineer

Fdetimes • Toronto

Hybrid
CAD 150,000 - 210,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / Pension
+3
Senior Backend Engineer (Remote) with AI & Microservices
Senior Backend Engineer (Remote) with AI & Microservices

Valsoft • Canada

Remote
CAD 154,000 - 175,000
Senior ML Infrastructure Engineer (Agentic AI)
Senior ML Infrastructure Engineer (Agentic AI)

Candidate • Toronto

Remote
CAD 120,000 - 170,000
Lunch stipend
Health benefits
RRSP matching / Pension
+5
Senior Full-Stack Engineer, Internal AI Tools
Senior Full-Stack Engineer, Internal AI Tools

Cohere • Toronto, Montreal

Hybrid
CAD 120,000 - 180,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Senior/Staff Software Engineer (Back-End), Inference
Senior/Staff Software Engineer (Back-End), Inference

Cohere • Ottawa, Toronto, Montreal

Hybrid
CAD 140,000 - 190,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Senior Full-Stack Engineer — AI Dashboard & Enterprise Apps
Senior Full-Stack Engineer — AI Dashboard & Enterprise Apps

Cohere • Toronto

Hybrid
CAD 100,000 - 150,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+5
Senior Backend & Platform Engineer: AI Memory & LLM Agents
Senior Backend & Platform Engineer: AI Memory & LLM Agents

HRB • Canada

Remote
CAD 120,000 - 180,000
Senior Staff Backend Engineer, AI-Driven Core Banking
Senior Staff Backend Engineer, AI-Driven Core Banking

Maximum Technologies • Toronto

On-site
CAD 140,000 - 190,000