Senior AI Architect: LLM & Multi-Agent Systems (Remote)

Randstad Canada; Toronto; Hybrid; CAD 150,000 - 210,000; Full time

Benefits offered by this job

Remote/Hybrid flexibility

Cutting-edge tech stack

High autonomy

Impactful growth

Job summary

Randstad Canada seeks an AI Architect to design and scale proprietary LLM infrastructure, agent orchestration, and context layers. You will build secure, scalable, multi-agent ecosystems and guide build-vs-buy decisions with ADRs for cross-functional teams.

Responsibilities include designing agent frameworks, memory integration, RAG pipelines, and governance. Strong Python and ML tooling experience required; hybrid/remote options available.

Qualifications

• Proven track record operationalizing LLM-driven architecture patterns.
• Strong coding foundation with hands-on Python experience.
• Experience with ML frameworks, vector databases and orchestration tools.

Responsibilities

• Architect framework-agnostic multi-agent systems and autonomous workflows.
• Integrate external tools, semantic memory endpoints, and manage conversation states.
• Design robust RAG pipelines with vector search and context optimization.
• Define dynamic model routing across open-source and proprietary models.
• Architect security, IAM/IAP controls, and token budgets.
• Instrument systems with OpenTelemetry to monitor latency and quality.

Skills

GenAI/LLM experience

Python

ML frameworks

Cloud platforms

Tools

Vector databases

LLM orchestration libraries

Job description

Randstad Canada seeks an AI Architect to design and scale proprietary LLM infrastructure, agent orchestration, and context layers. You will build secure, scalable, multi-agent ecosystems and guide build-vs-buy decisions with ADRs for cross-functional teams.

Responsibilities include designing agent frameworks, memory integration, RAG pipelines, and governance. Strong Python and ML tooling experience required; hybrid/remote options available.