Senior Software Engineer

zofiQ; Toronto; Hybrid; CAD 90,000 - 120,000; Full time

Job summary

A tech company specializing in AI solutions is seeking a motivated Senior Software Engineer to enhance their core infrastructure powering AI functionalities. This hybrid role in Toronto involves designing scalable backend pipelines and maintaining APIs, with a focus on optimizing LLM performance. Candidates should have experience in async workflows and a good grasp of both Node.js and MongoDB, alongside a solid foundation in machine learning concepts.

Benefits

Competitive compensation and benefits

Opportunity to work with cutting-edge AI technologies

Direct reimbursement for productivity tools

Remote work flexibility

Qualifications

• Experience in creating train/val/test splits and tracking metrics.
• Familiarity with managing serverless deployments on AWS.

Responsibilities

• Design and build scalable Python-based backend pipelines for LLM agents.
• Maintain and extend REST APIs and real-time endpoints.
• Measure and improve performance of LLM agents.

Skills

Experience with async workflows

Proven ability to optimize for throughput and latency

Basic Node.js / TypeScript

Intermediate MongoDB experience

Basic machine learning understanding

Tools

Python testing frameworks

TypeScript testing tools

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from zofiQ

We’re hiring a Senior Software Engineer to own and scale the core infrastructure powering our AI agent platform, from backend workflows and orchestration layers to LLM pipeline optimization and real-time service delivery. You’ll collaborate across product, ML, and infrastructure teams to push agent capabilities into production at scale.

This is a hybrid role based in Toronto, ON. We are open to remote for exceptional candidates.

What You'll Own

• Design, build, and optimize scalable Python-based backend pipelines for LLM agents (async, streaming, tool orchestration)
• Maintain and extend our REST APIs (Node.js / TypeScript) and real-time endpoints (WebSockets / SSE)
• Build agent orchestration and workflow systems using AWS Step Functions, Lambda, and Fargate
• Implement vector-adjacent metadata stores and tune MongoDB for high-QPS workloads
• Ship AI agents with retrieval, prompt orchestration, tool-calling, and safety mechanisms
• Measure and improve performance of LLM agents (latency, throughput, correctness)
• Write test-driven code with unit and integration tests using Python / TypeScript test frameworks

Qualification

• Experience with async workflows, LLM / agent pipelines
• Proven ability to optimize for throughput and latency

Basic Node.js / TypeScript (Express) :

• Ability to maintain REST APIs
• Experience with real-time endpoints (WebSockets / SSE) and middleware
• Familiar with Lambda, Fargate, Step Functions
• Capable of managing IaC with CDK and setting up per-tenant stacks

Intermediate MongoDB experience :

• Competent in schema design and index tuning
• Able to handle vector-metadata storage and perform replica-set operations and migrations
• Delivered production-ready LLM agent workflows
• Hands-on with prompt orchestration, tool use, and agent evaluation

Basic machine learning understanding :

• Know how to create train / val / test splits and track metrics like accuracy, precision / recall, F1
• Able to assess prompt vs. fine-tuning tradeoffs
• Familiarity with Python testing frameworks (unittest, pytest)
• Exposure to TypeScript testing tools like Jest

Nice to Haves

• Familiarity with vector databases and similarity search at scale
• CI / CD pipelines via GitHub Actions or AWS CodeBuild
• SaaS multi-tenant security (IAM, secret rotation, least privilege)
• Experience in early-stage startups or building platforms from zero
• End-to-end testing (Cypress, Playwright, Puppeteer)

What We Offer

• Competitive compensation and benefits
• Opportunity to work on leading-edge AI technologies with a highly driven team
• Direct reimbursement for productivity tools
• Remote work flexibility

We are an equal opportunity employer.

It’s easier to invent the future than to predict it” — Alan Kay

Seniority level

Seniority level

Mid-Senior level

Employment type

Employment type

Full-time

Job function

Job function

Engineering and Information Technology

Technology, Information and Internet

Referrals increase your chances of interviewing at zofiQ by 2x

Sign in to set job alerts for “Senior Software Engineer” roles.

Software Engineer, Backend (All Levels / All Teams)

Software Engineer I, Entry Level (Fall 2024-Spring 2025) - Toronto

Software Developer Full Stack (Junior) 9063-1115

Frontend Software Engineer (Remote - Canada)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

J-18808-Ljbffr

Create a job alert for this search

Senior Software Engineer • Toronto, ON, Canada