AI Engineer (RAG & Retrieval)

RFPs.ai

Canada

On-site

CAD 90,000 - 125,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

RFPs.ai is developing explainable semantic matching between company capabilities and live RFPs. You will work on retrieval, ranking, and evaluation, and partner with engineering on ingestion quality, offline evals, and production monitoring of relevance.

You will design and tune retrieval pipelines, build evaluation sets, and experiment with chunking, metadata filters, and reranking strategies for long solicitations.

Qualifications

  • 2+ years applied ML or search engineering in production.
  • Experience with embeddings, vector stores, or hybrid retrieval.
  • Proficiency in Python and translating research ideas into shipped code.
  • Structured approach to offline metrics before rolling out ranking changes.
  • Ability to explain trade-offs to non-ML teammates and customers.

Responsibilities

  • Design and tune retrieval pipelines over procurement documents and customer-uploaded profiles.
  • Build evaluation sets and regression tests for relevance, citation accuracy, and latency.
  • Experiment with chunking, metadata filters, and reranking strategies for long solicitations.
  • Ship improvements to match explanations (cited requirement spans shown to users).
  • Document model and index changes so the team can reproduce results.

Skills

Embeddings
Vector stores
Hybrid retrieval
Python
Offline metrics
Model explainability

Tools

Python
Jupyter
Pytorch

Job description

Our core product is explainable semantic matching between company capabilities and live RFPs. You will work on retrieval, ranking, and evaluation, not generic chat wrappers.

You will partner with engineering on ingestion quality, offline evals, and production monitoring of relevance.

What you'll do
  • Design and tune retrieval pipelines over procurement documents and customer-uploaded profiles.
  • Build evaluation sets and regression tests for relevance, citation accuracy, and latency.
  • Experiment with chunking, metadata filters, and reranking strategies for long solicitations.
  • Ship improvements to match explanations (cited requirement spans shown to users).
  • Document model and index changes so the team can reproduce results.
What we're looking for
  • 2+ years applied ML or search engineering in production.
  • Hands-on experience with embeddings, vector stores, or hybrid retrieval.
  • Python proficiency and comfort reading research papers and translating ideas into shipped code.
  • Structured approach to offline metrics before rolling out ranking changes.
  • Ability to explain trade-offs to non-ML teammates and customers.
Nice to have
  • Experience with RAG evaluation frameworks (e.g. Ragas-style workflows).
  • Knowledge of government contracting terminology (NAICS, FAR, evaluation criteria).
  • Familiarity with prompt structuring for extraction tasks (not open-ended chat).
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI
Senior Software Engineer, AI

GuruLink • Toronto

Hybrid
CAD 110,000 - 170,000
Full Stack Engineer
Full Stack Engineer

RFPs.ai • Canada

Remote
CAD 90,000 - 120,000
Applied AI Engineer
Applied AI Engineer

Luxoft • Canada

On-site
CAD 120,000 - 180,000
AI Developers
AI Developers

BrainRidge Consulting • Toronto

On-site
CAD 120,000 - 160,000
AI Engineer
AI Engineer

Fortiv Technical Inc. • Toronto

Hybrid
CAD 160,000 - 210,000
Senior AI Engineer
Senior AI Engineer

Web.com Canada, Inc. • Canada

On-site
CAD 120,000 - 170,000
Senior Agentic AI Engineer
Senior Agentic AI Engineer

enableIT • Toronto

On-site
CAD 120,000 - 180,000
Software Engineer: AI
Software Engineer: AI

Aloe • Vancouver

Hybrid
CAD 90,000 - 130,000
Competitive compensation
Benefits
Career growth opportunities
Staff AI Developer - Vancouver
Staff AI Developer - Vancouver

robotsandpencils • Vancouver

On-site
CAD 150,000 - 190,000
AI Engineer
AI Engineer

OpenReplay • Quebec

On-site
CAD 90,000 - 150,000