Staff GenAI ML Engineer — Secure, Scalable AI Systems

Triwill Group; Toronto; Hybrid; CAD 168,000 - 231,000; Full time

Job summary

Okta Canada is seeking a Staff Machine Learning Engineer for the Generative AI team to shape and accelerate our AI strategy. You will design production-ready ML/GenAI systems, from model development to platform services, and ensure tight integration with security and product teams.

You will build scalable infrastructure, implement retrieval-augmented workflows, and mentor engineers while delivering safe, high-quality AI solutions across the enterprise.

Qualifications

• 7+ years of software development experience, with Python
• Hands-on experience with applied machine learning, from feature engineering to training and fine-tuning models.
• Hands-on experience with modern Generative AI platforms (AWS Bedrock, OpenAI, Anthropic, etc.).
• Deep understanding of retrieval-augmented generation (RAG), embeddings, and knowledge-base workflows.
• Hands-on experience with AI agent frameworks like LiteLLM, LangGraph, LangChain, LlamaIndex, MCP.
• Familiarity with ML frameworks (FastAPI, PyTorch, TensorFlow, Spark ML) and orchestration tools (Airflow).

Responsibilities

• Spearhead the design of scalable, observable ML and Generative AI systems that integrate retrieval, inference, and evaluation pipelines.
• Develop and iterate on structured prompting, context retrieval, and RAG workflows that improve accuracy, safety, and cost efficiency in Claude-based systems.
• Build and refine automated evaluation pipelines to measure model quality, correctness, groundedness, and safety in production.
• Implement schema validation, structured output enforcement, and other guardrails that keep AI outputs reliable, auditable, and compliant with enterprise standards.
• Mentor and coach engineers, contributing to the growth of the team and the larger engineering community.

Skills

Python

Go/TS familiarity

ML/GenAI

LLMOps

LangChain

PyTorch

TensorFlow

FastAPI

Airflow

RAG

Tools

AWS Bedrock

OpenAI

Anthropic

LiteLLM

LangGraph

LangChain

LlamaIndex

MCP

PyTorch

TensorFlow

FastAPI

Airflow

Job description

Okta Canada is seeking a Staff Machine Learning Engineer for the Generative AI team to shape and accelerate our AI strategy. You will design production-ready ML/GenAI systems, from model development to platform services, and ensure tight integration with security and product teams.

You will build scalable infrastructure, implement retrieval-augmented workflows, and mentor engineers while delivering safe, high-quality AI solutions across the enterprise.