Agentic AI Platform Engineer II

Socure; Toronto; On-site; CAD 110,000 - 150,000; Full time

Job summary

Socure is hiring a Software Engineer II to help build and harden a secure, vendor-agnostic agent platform. You will work with senior engineers to design components for orchestration, memory, and tool use, ensuring safe, scalable production systems.

You’ll bring strong knowledge of LLMs, agentic AI, and GPU-based model serving, plus experience in distributed systems and backend development. Collaboration with cross-functional teams is essential to success.

Qualifications

• Bachelor’s or Master’s degree in CS/CE/ML or equivalent practical experience.
• 2+ years of professional software engineering in distributed systems.
• Strong knowledge of LLMs, agentic AI, and model serving.
• Experience with GPU computing and backend infrastructure is a plus.
• Proficiency in Java, Go, Python, or similar.

Responsibilities

• Build components of a vendor-agnostic agent platform under senior guidance.
• Develop evaluation tools to measure agent performance and safety.
• Implement governance controls and guardrails for agents.
• Develop data grounding, retrieval, and memory components.
• Prototype agent behaviors and multi-step coordination with tools.

Skills

Distributed systems

Backend development

Communication skills

Ambiguity tolerance

Team collaboration

Education

Bachelor’s or Master’s in CS/CE/ML

Tools

CUDA

vLLM

Ollama

TensorRT-LLM

Triton Inference Server

Job description

Socure is hiring a Software Engineer II to help build and harden a secure, vendor-agnostic agent platform. You will work with senior engineers to design components for orchestration, memory, and tool use, ensuring safe, scalable production systems.

You’ll bring strong knowledge of LLMs, agentic AI, and GPU-based model serving, plus experience in distributed systems and backend development. Collaboration with cross-functional teams is essential to success.