Software Engineer II

Socure; Toronto; On-site; CAD 100,000 - 160,000; Full time

Job summary

Socure is building an identity trust platform and is hiring a Software Engineer II for the Agentic AI Foundations team. You will design, build, and harden a secure, vendor-agnostic agent platform and work with senior engineers to shape architectural direction.

You will gain exposure to agentic AI, LLMs, and GPU-based model serving, growing into greater ownership as you contribute to production-ready systems and tools in a fast-moving environment.

Qualifications

• 2+ years of professional software engineering experience.
• Strong knowledge of LLMs and agentic AI systems.
• Solid understanding of GPU computing and model serving.
• Foundations in distributed systems, concurrency, observability, and performance.
• Proficiency in a backend language (Java, Go, Python, etc.).
• Ability to work in ambiguous, early-stage problem spaces with guidance.
• Track record of technical impact through projects or contributions.
• Strong collaboration with product, data science, platform, and security.

Responsibilities

• Build components of a vendor-agnostic agent platform under guidance from senior engineers.
• Implement evaluation tooling, metrics, and pipelines to improve agent performance and safety.
• Help implement safety, governance controls, including guardrails and human-in-the-loop reviews.
• Build data grounding, memory, and context management for agents.
• Prototype agent behaviors, planning, and multi-step execution with real workflows.
• Collaborate with product and engineering to enable agent-powered workflows.
• Refine best practices for secure, observable, and scalable agent systems.
• Apply knowledge of LLMs, GPU computing, and model serving to technical decisions.

Skills

Distributed systems

Backend programming

LLMs/Agentic AI

GPU computing

Observability

Cloud-native infra

Communication

Education

Bachelor's or Master's in CS/Engineering/ML

Tools

CUDA

vLLM

Ollama

TensorRT-LLM

Triton Inference Server

Job description

Socure is building the identity trust infrastructure for the digital economy — verifying 100% of good identities in real time and stopping fraud before it starts. The mission is big, the problems are complex, and the impact is felt by businesses, governments, and millions of people every day.

We hire people who want that level of responsibility. People who move fast, think critically, act like owners, and care deeply about solving customer problems with precision. If you want predictability or narrow scope, this won’t be your place. If you want to help build the future of identity with a team that holds a high bar for itself — keep reading.

About the Role

The Agentic AI Foundations team is building the core platform, systems, and primitives that enable Socure to transition from traditional software workflows to agent-native operations. As a Software Engineer II on the team, you will help design, build, and harden a secure, evaluable, vendor-agnostic agent platform that teams across Socure can build on, working alongside senior and staff engineers who set the architectural direction.

This is a hands-on, zero-to-one team, and you’ll get outsized exposure to how agentic systems are architected and operated in production. You’ll bring strong foundational knowledge of LLMs, agentic AI, and GPU/model serving through academic, research, professional, open-source, or other relevant experience, and grow into greater ownership as you build alongside senior engineers on the team.

What You’ll Do

• Build components of a vendor-agnostic agent platform — including orchestration, tool use, memory, and runtime systems — under the guidance of senior engineers on the team.
• Implement evaluation and reliability tooling, including metrics, harnesses, and pipelines, to measure and improve agent performance, robustness, and safety in production.
• Help implement safety and governance controls, including guardrails, policy enforcement, and human-in-the-loop review mechanisms.
• Build data grounding, retrieval, and memory components that keep agents accurate, context-aware, and aligned with Socure’s domain knowledge and policies.
• Prototype and iterate on agent behaviors, including planning, multi-step execution, and coordination of tools and services, using real internal workflows as proving grounds.
• Partner with product and engineering teams to implement agent-powered workflows using the platform primitives the team builds.
• Apply and help refine documented best practices and design patterns for secure, observable, and scalable agent systems.
• Bring strong foundational knowledge of LLMs, GPU computing, and model serving to technical discussions and implementation decisions.

What You’ll Bring

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Machine Learning/AI, or a related field from top tier institutions, or equivalent practical experience demonstrating strong foundations in computer science and machine learning.
• 2+ years of professional software engineering experience, with demonstrated experience in distributed systems, backend platforms, infrastructure, or comparable technical environments.
• Very strong foundational knowledge of large language models and agentic AI systems, including architectures, prompting and orchestration patterns, tool use, and evaluation approaches.
• Strong foundational understanding of GPU computing and model-serving infrastructure, such as CUDA, vLLM, Ollama, LLMLite, TensorRT-LLM, Triton Inference Server, or similar technologies, including the performance and cost trade-offs associated with serving LLMs at scale.
• Solid grounding in distributed systems fundamentals, including concurrency, fault tolerance, observability, and performance.
• Proficiency in at least one modern backend programming language and ecosystem, such as Java, Go, Python, or similar, with comfort working with cloud-native infrastructure, APIs, and data services.
• Ability to work productively in ambiguous, early-stage problem spaces with guidance from senior engineers, translating direction into working software.
• A track record of strong technical performance demonstrated through professional impact, research, challenging technical projects, open-source contributions, internships, or other relevant work.
• Strong collaboration and communication skills, with comfort working alongside cross-functional partners such as product, data science, platform, and security.

Preferred Qualifications

• Experience with multi-agent systems, workflow orchestration, or distributed coordination frameworks through professional work, research, coursework, or technical projects.
• Experience building or using agent platforms — such as orchestration frameworks, tool registries, or memory systems — or LLM routing, caching, or fine-tuning pipelines through professional work, research internships, open-source contributions, or personal projects.
• Exposure to evaluation frameworks, experimentation platforms, or ML systems, such as offline/online evaluations, A/B testing, or agent and model benchmarking.
• Experience with AI safety, security, or policy systems — including guardrails, policy engines, content filters, or responsible AI frameworks — through professional work, research, coursework, or technical projects.
• Experience with retrieval systems, knowledge graphs, or data platforms used to ground LLMs and agents in enterprise contexts.
• Demonstrated depth in ML systems or LLM infrastructure through professional impact, research publications, technical projects, competition results, open-source contributions, or comparable experience.

Socure is an equal opportunity employer that values diversity in all its forms within our company. We do not discriminate based on race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

If you need an accommodation during any stage of the application or hiring process—including interview or onboarding support—please reach out to your Socure recruiting partner directly.