Agentic AI Platform Engineer II

Doist; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Job summary

Socure is seeking a Software Engineer II to help design, build, and harden a secure, vendor-agnostic agent platform used across product teams.

You will work with senior engineers on architecture, focusing on LLMs, agentic AI, and GPU-powered model serving to deliver reliable, scalable systems in production.

Join a hands-on, zero-to-one team shaping the future of identity with rigorous engineering practices and cross-functional collaboration.

Qualifications

• Bachelor’s or Master’s degree in CS/CE/ML or equivalent practical experience.
• 2+ years of professional software engineering in distributed systems.
• Strong knowledge of large language models and agentic AI systems.
• Understanding GPU computing and model-serving infrastructure (CUDA, vLLM, Ollama, LLMLite, TensorRT‑LLM, Triton).
• Proficiency in at least one backend language (Java, Go, Python).
• Ability to work in ambiguous, early-stage problem spaces with guidance from senior engineers.
• Strong collaboration and communication across cross-functional teams.

Responsibilities

• Build components of a vendor-agnostic agent platform — orchestration, tool use, memory, and runtime systems.
• Implement evaluation and reliability tooling to measure and improve performance, robustness, and safety.
• Help implement safety and governance controls, including guardrails and human-in-the-loop review.
• Build data grounding, retrieval, and memory components to keep agents context-aware.
• Prototype and iterate on agent behaviors including planning and multi-step execution.
• Partner with product and engineering teams to implement agent-powered workflows.
• Refine best practices for secure, observable, and scalable agent systems.
• Contribute foundational knowledge of LLMs, GPU computing, and model serving in design decisions.

Skills

Distributed systems

Backend development

LLMs / AI

GPU computing

Cloud-native infrastructure

API development

Problem solving

Education

Bachelor’s or Master’s degree in Computer Science / Computer Engineering / ML

Tools

CUDA

vLLM

Ollama

LLMLite

TensorRT-LLM

Triton Inference Server

Job description

Socure is seeking a Software Engineer II to help design, build, and harden a secure, vendor-agnostic agent platform used across product teams.

You will work with senior engineers on architecture, focusing on LLMs, agentic AI, and GPU-powered model serving to deliver reliable, scalable systems in production.

Join a hands-on, zero-to-one team shaping the future of identity with rigorous engineering practices and cross-functional collaboration.