LLM Solutions Architect for Production AI Systems

Open Systems Technologies; Mississauga; On-site; CAD 110,000 - 170,000; Full time

Job summary

Open Systems Technologies seeks an LLM Solutions Developer to design, build, and deploy production-grade LLM-powered solutions in Mississauga. The role focuses on end-to-end architecture, multi-agent orchestration, and safe, scalable AI systems. Contract-to-hire with collaboration across product, data science, and platform teams.

Mandatory if Karat test is cleared, you will work on API development, tool integrations, RAG pipelines, and observability to ensure reliable AI services.

Qualifications

• Hands-on experience building and deploying LLM-based applications in production environments.
• Deep understanding of prompt engineering, few-shot learning, chain-of-thought, and instruction tuning.
• Experience with agentic AI frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or similar.
• Familiarity with MCP and context window management strategies.
• Experience implementing guardrails for LLM outputs (content filtering, hallucination mitigation, policy enforcement).
• Knowledge of RAG architectures, vector search, and embedding pipelines.

Responsibilities

• Design & develop end-to-end LLM-based solutions for production use.
• Build autonomous and semi-autonomous AI agents with multi-step reasoning and tool use.
• Architect LLM orchestration pipelines and manage memory/context handling.
• Implement MCP-compliant architectures for structured model communication.
• Integrate guardrails to ensure safety, accuracy, and policy compliance.
• Develop RESTful or gRPC APIs for LLM-powered services; integrate with external systems.
• Create tools, plugins, and function-calling integrations to extend capabilities.
• Develop RAG pipelines using vector databases and embeddings.
• Establish observability with tracing and monitoring dashboards.

Skills

LLM Development

Prompt Engineering

Agentic AI frameworks

MCP Context Protocol

Guardrails & Safety

RAG & Embeddings

Job description

Open Systems Technologies seeks an LLM Solutions Developer to design, build, and deploy production-grade LLM-powered solutions in Mississauga. The role focuses on end-to-end architecture, multi-agent orchestration, and safe, scalable AI systems. Contract-to-hire with collaboration across product, data science, and platform teams.

Mandatory if Karat test is cleared, you will work on API development, tool integrations, RAG pipelines, and observability to ensure reliable AI services.