Staff GenAI Architect & Production Leader

Robots and Pencils; Canada; Remote; CAD 177,000 - 244,000; Full time

Job summary

Robots & Pencils is seeking a Staff AI Builder to lead the design and delivery of AI/ML systems, owning end-to-end architecture and producing production-ready results. You will shape AI integration for enterprise workflows, guiding cross-functional teams on reliability, security, and scalability while setting engineering standards.

You will lead model development and optimization, build and supervise agentic workflows, and drive evaluation, observability, and deployment across the stack in a

Qualifications

• 6+ years of professional software engineering experience, including meaningful time shipping GenAI/LLM-powered systems in production.
• Hands-on depth in agentic AI: reasoning loops, tool/function calling, multi-agent orchestration.
• Practical RAG expertise: chunking strategies, embeddings, vector databases (OpenSearch or similar), cosine similarity search, and re-ranking.
• Experience building evaluation and observability for LLM systems: golden datasets, LLM-as-judge, tracing tools.
• Strong prompt engineering skills with production system prompts and constraints on requests.
• Hands-on experience with the AWS GenAI stack: Bedrock, Agent Core, Lambda, DynamoDB (single-table design), S3, SQS, EventBridge, Step Functions.
• Strong Python and Node.js skills, with experience building full-stack apps and RESTful APIs.
• Solid understanding of production reliability patterns: retries/backoff, circuit breakers, fallback models.
• Experience with Docker and cloud-native deployment.
• Comfort owning ambiguous, integration-heavy problems and drilling down when challenged.

Responsibilities

• Design and lead AI architecture, model development, and optimization across AI systems.
• Define agentic workflows, tool calling, and orchestration across single- and multi-agent architectures.
• Build and maintain RAG pipelines, including embeddings, vector search, and re-ranking.
• Integrate with AWS Bedrock and Agent Core, ensuring precise tool routing by design.
• Write and iterate production system prompts with constraints and few-shot design.
• Build evaluation and observability into agents, using datasets, LLM-as-judge, and tracing.
• Collaborate with product and design to scope features and ship end-to-end.
• Own features and releases, including debugging, hardening, and production reliability.
• Contribute to frontend integration points and ensure clean, testable code across the stack.

Skills

Agentic AI

RAG

Python

Node.js

AI architecture

LangSmith/LangFuse

Cloud deployment

Docker

Bedrock

DynamoDB

Tools

OpenSearch

Lambda

S3

SQS

EventBridge

Job description

Robots & Pencils is seeking a Staff AI Builder to lead the design and delivery of AI/ML systems, owning end-to-end architecture and producing production-ready results. You will shape AI integration for enterprise workflows, guiding cross-functional teams on reliability, security, and scalability while setting engineering standards.

You will lead model development and optimization, build and supervise agentic workflows, and drive evaluation, observability, and deployment across the stack in a