LLM Solutions Developer (Agentic AI & Orchestration)

Software Guidance & Assistance, Inc. (SGA, Inc.); Mississauga; On-site; CAD 120,000 - 170,000; Full time

Job summary

Software Guidance & Assistance, Inc. (SGA), in Mississauga, Ontario, seeks an LLM Solutions Developer to build production-grade AI systems and orchestration frameworks. The role focuses on agentic AI, multi-agent workflows, and robust tool integrations.

You will design end-to-end LLM-based solutions, implement MCP-compliant architectures, and ensure safety with guardrails while collaborating with product teams to deliver scalable software in a financial services context.

Qualifications

• Hands-on experience building and deploying LLM-based applications in production environments.
• Deep understanding of prompt engineering, few-shot learning, chain-of-thought, and instruction tuning.
• Experience with agentic AI frameworks (LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar).
• Familiarity with Model Context Protocol (MCP) and context window management strategies.
• Experience implementing guardrails for LLM outputs (content filtering, hallucination mitigation, policy enforcement).
• Knowledge of RAG architectures, vector search, and embedding pipelines.

Responsibilities

• Design, build, and deploy production-grade LLM-powered solutions.
• Architect end-to-end LLM-based applications for multi-step reasoning and decision support.
• Develop agentic AI systems with multi-agent workflows and tool use.
• Manage orchestration pipelines and context handling across models and tools.
• Implement MCP-compliant architectures for structured inter-model communication.
• Integrate guardrails to ensure safety, accuracy, and policy compliance.
• Develop RESTful or gRPC APIs and connect with external systems and databases.

Skills

LLM Applications

Prompt Engineering

Agentic AI

MCP (Model Context Protocol)

Guardrails

RAG

APIs

Cloud/NF

Python

Async/Microservices

Tools

LangChain

LangGraph

AutoGen

CrewAI

Semantic Kernel

OpenTelemetry

Pinecone/Weaviate

Job description

Software Guidance & Assistance, Inc., (SGA), is searching for a LLM Solutions Developer (Agentic AI & Orchestration) for a right to hire assignment with one of our premier financial services clients in Mississauga, ON.

Responsibilities

• Looking for a talented and forward-thinking LLM Solutions Developer to join our AI Engineering team. In this role, you will design, build, and deploy production-grade solutions powered by Large Language Models (LLMs). You will work at the intersection of cutting-edge AI research and real-world software engineering, delivering intelligent, reliable, and scalable agentic systems.
• Design & Develop LLM-Based Solutions: Architect and implement end-to-end applications leveraging LLMs (e.g., GPT-4, Claude, Gemini, Llama) for tasks such as reasoning, summarization, code generation, and decision support.
• Agentic AI Systems: Build autonomous and semi-autonomous AI agents capable of multi-step reasoning, tool use, and goal-directed behavior using frameworks such as LangGraph, AutoGen, CrewAI, or custom implementations.
• Orchestration: Design and manage complex LLM orchestration pipelines, including multi-agent workflows, task routing, memory management, and context handling.
• Model Context Protocol (MCP): Implement and integrate MCP-compliant architectures to enable structured, context-aware communication between models, tools, and external systems.
• Guardrails & Safety: Integrate guardrail frameworks (e.g., NeMo Guardrails, Guardrails AI, custom rule engines) to enforce output safety, factual accuracy, policy compliance, and ethical AI standards.
• API Development & Integration: Design and expose RESTful or gRPC APIs for LLM-powered services; integrate with third-party APIs, enterprise systems, and data sources.
• Tool & Plugin Development: Build custom tools, plugins, and function-calling integrations that extend LLM capabilities (e.g., web search, database queries, code execution, document retrieval).
• RAG Pipelines: Develop Retrieval-Augmented Generation (RAG) systems using vector databases (e.g., Pinecone, Weaviate, pgvector) and embedding models.
• Evaluation & Observability: Implement LLM evaluation frameworks, tracing (e.g., LangSmith, OpenTelemetry), and monitoring dashboards to ensure quality, performance, and reliability.
• Collaboration: Work closely with product managers, data scientists, and platform engineers to translate business requirements into robust AI solutions.
• Documentation: Produce clear technical documentation, architecture diagrams, and runbooks for all developed systems.

Required Skills

• Core LLM & AI
  • Hands-on experience building and deploying LLM-based applications in production environments
  • Deep understanding of prompt engineering, few-shot learning, chain-of-thought, and instruction tuning
  • Experience with agentic AI frameworks (LangChain, LangGraph, AutoGen, CrewAI, Semantic Kernel, or similar)
  • Familiarity with Model Context Protocol (MCP) and context window management strategies
  • Experience implementing guardrails for LLM outputs (content filtering, hallucination mitigation, policy enforcement)
  • Knowledge of RAG architectures, vector search, and embedding pipelines
• Orchestration & Infrastructure
  • Experience designing multi-agent orchestration workflows and task delegation patterns
  • Proficiency with API design and development (REST, GraphQL, or gRPC)
  • Familiarity with tool/function calling patterns in LLM APIs (OpenAI function calling, Anthropic tool use, etc.)
  • Experience with cloud platforms (AWS, GCP, or Azure) and containerization (Docker, Kubernetes)
• Software Engineering
  • Strong proficiency in Python (primary); familiarity with TypeScript/JavaScript is a plus
  • Experience with asynchronous programming, microservices, and event-driven architectures
  • Solid understanding of software design patterns, clean code principles, and test-driven development
  • Version control with Git and CI/CD pipeline experience

SGA is a technology and resource solutions provider driven to stand out. We are a women-owned business. Our mission: to solve big IT problems with a more personal, boutique approach. Each year, we match consultants like you to more than 1,000 engagements. When we say let's work better together, we mean it. You'll join a diverse team built on these core values: customer service, employee development, and quality and integrity in everything we do. Be yourself, love what you do and find your passion at work. Please find us at https://sgainc.com/.

SGA is an Equal Opportunity Employer and does not discriminate on the basis of Race, Color, Sex, Sexual Orientation, Gender Identity, Religion, National Origin, Disability, Veteran Status, Age, Marital Status, Pregnancy, Genetic Information, or Other Legally Protected Status. We are committed to providing access, equal opportunity, and reasonable accommodation for individuals with disabilities in employment, and our services, programs, and activities. Please visit our company EEO page to request an accommodation or assistance regarding our policy