Senior Software Developer, LLM Infrastructure

Jaide Health; Toronto; On-site; CAD 140,000 - 190,000; Full time

Benefits offered by this job

Top-tier health benefits

Life insurance

Wealthsimple for Business match

20 vacation days

Job summary

Wealthsimple is Canada’s leading financial innovator, building a scalable ML infrastructure team to power AI initiatives. As a Senior Software Engineer, you will design backend systems and infrastructure to support high-performance AI workloads.

You will work with data scientists, platform engineers, and engineering leaders to scale GenAI responsibly, deploying model-routing, GPU infrastructure, and evaluation tooling while optimizing costs and ensuring reliability.

Qualifications

• 6+ years of software engineering experience building production-ready distributed systems or data platform infrastructure.
• Strong proficiency in Python and infrastructure tooling like Kubernetes and Terraform.
• Practical experience with open-source AI systems and model serving architectures.
• Familiarity with AI tooling and evaluation frameworks and end-to-end project ownership.

Responsibilities

• Design and implement core backend and infrastructure powering AI systems.
• Collaborate with data scientists, platform engineers, and engineering leaders to scale GenAI footprint securely.
• Build model-routing architecture to direct requests across internal/external models.
• Provision and manage high-performance GPU infrastructure for serving open-source LLMs.
• Develop evaluation frameworks to benchmark model quality against production requirements.
• Drive cost-optimization and infrastructure efficiency without sacrificing reliability.

Skills

Python

Kubernetes

Terraform

FastAPI

Distributed systems

Model routing

Tools

LiteLLM

vLLM

Ray

Kafka

Postgres

Redshift

Snowflake

AWS GPU

Job description

Build something people love

Wealthsimple is Canada’s leading financial innovator. The company offers a full suite of simple, sophisticated financial products across managed investing, do-it-yourself trading, cryptocurrency, tax filing, spending and saving. Wealthsimple currently serves more than 4 million Canadians and holds over $155 billion in assets under administration. The company was founded in 2014 by a team of financial experts and technology entrepreneurs, and is headquartered in Toronto, Canada.

We're proud of what we've built — and we're just getting started. Read our Culture Manual and learn more about how we work.

Machine Learning Infrastructure Team

The Machine Learning Infrastructure team builds the core foundation powering AI and GenAI initiatives across Wealthsimple. As our AI footprint expands, our priority is building scalable, cost-effective infrastructure that enables high-performance inference using open-source models alongside vendor solutions. Our responsibilities are to:

• Build and maintain infrastructure to host and serve open-source LLMs reliably on cloud/GPU systems.
• Implement intelligent model-routing frameworks to optimize performance, cost, and latency.
• Develop evaluation and benchmarking tooling (Evals) to test, validate, and compare model performance across use cases.
• Set the technical direction for operating scalable LLM infrastructure company-wide.

The Role

As a Senior Software Engineer on the ML Infrastructure team, you will design and implement the core backend and infrastructure powering our AI systems. You will work closely with data scientists, platform engineers, and engineering leaders to scale our GenAI footprint efficiently and securely.

In this role, you will have the opportunity to:

• Build model-routing architecture (e.g., LiteLLM integration) to dynamically direct requests across internal and external models.
• Provision and manage high-performance GPU infrastructure for serving open-source LLMs.
• Build evaluation frameworks (Evals) that enable engineers and data scientists to benchmark model quality against production requirements.
• Drive key cost-optimization and infrastructure efficiency initiatives without sacrificing system accuracy or reliability.

We are looking for people who have:

• 6+ years of software engineering experience building production-ready distributed systems or data platform infrastructure.
• Strong proficiency in Python and infrastructure tooling like Kubernetes and Terraform.
• Proven experience designing and operating highly performant, observable backend systems.
• Practical experience or deep familiarity with the modern AI ecosystem (e.g., serving open-source models, vLLM, Ray, model routing, or evaluation frameworks).
• Track record of owning technical projects end-to-end with high autonomy.

Our stack includes:

• Container & Infra: Kubernetes, Terraform, AWS GPU infrastructure
• Languages & APIs: Python, FastAPI
• LLM Tooling & Serving: LiteLLM, vLLM, Ray, Bedrock
• Data & Streaming: Kafka, Postgres, Redshift, Snowflake

Why Wealthsimple?

Top-tier health benefits and life insurance

Long-term group savings with employer match, through Wealthsimple for Business

20 vacation days, 4 wellness days, and unlimited sick and mental health days per year

90 days away: work outside Canada for up to 90 days per year

Employee resource groups, including Rainbow (2SLGBTQ), Women of WS, and Black at WS

We are a hybrid team with over 1,500 employees across North America. The people are one of the best parts of working here: you'll collaborate with incredibly talented, curious, and driven teammates who are deeply committed to doing great work.

ICYMI

Technology & Innovation at Wealthsimple: We move quickly and build thoughtfully. That means we're always looking for better ways to work — whether that's new tools, AI, or rethinking how we approach a problem. We don't expect you to have all the answers, but we do expect curiosity and a willingness to evolve alongside the products we're building.

Inclusion Statement: We're building products for a diverse world, and we need a diverse team to do it well. We strongly encourage applications from everyone, regardless of race, religion, colour, national origin, gender, sexual orientation, age, marital status, or disability status.

Accessibility Statement: We're committed to an accessible hiring experience. If you need any accommodations throughout the interview process, please let us know — we'll work with you to make sure you have what you need. We also welcome any feedback on how we can better accommodate candidates with accessibility needs.

AI in Hiring: We may use artificial intelligence (AI) tools to support parts of our hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our team but don't replace human judgment – all final hiring decisions are made by people. If you have questions about how your data is used, reach out to us.