AI Software Engineer

Mash

Toronto

On-site

CAD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

MASH is seeking an AI-focused software engineer to shape and ship core AI features for the Mash platform from Toronto. You will architect LLM-powered solutions, manage related infrastructure, and apply retrieval-augmented generation techniques while building data pipelines and evaluation tooling.

As part of a cross-functional team, you will stay abreast of ML/NLP research, prototype new techniques, and translate user needs into scalable backend systems.

Qualifications

  • 4+ years of building production software at scale with a multi-year focus on AI.
  • Proficiency in 1+ programming languages, such as Python, Go, Rust, C++, or Java.
  • You've shipped LLM-powered features to real users: agents and tool calling, context design, retrieval and structured outputs.
  • You've built evals, datasets or regression checks that drive meaningful and provable improvement in a customer/user experience.
  • Experience with event-driven systems, building cloud-native software and data pipelines.
  • Strong understanding of backend system design and scalable architectures.
  • You use AI coding agents as a normal part of how you build.
  • Bonus: agent harnesses, structured interactions, speech or audio pipelines, entity resolution, privacy-preserving ML.

Responsibilities

  • Ship core AI features within the Mash platform.
  • Architect LLM-powered solutions and manage related infrastructure.
  • Apply information retrieval techniques for search and retrieval-augmented generation (RAG).
  • Develop processes and tooling for measuring and iterating on LLM output quality.
  • Create tooling to collect and leverage internal datasets for evaluation, few-shot prompting, fine-tuning and more.
  • Develop bespoke ML/NLP models, when appropriate.
  • Build production data pipelines to ingest knowledge sources.
  • Stay up to date on cutting-edge research in the ML/NLP space and apply new techniques.
  • Work closely with a cross-functional team (product, design, engineering).
  • Discover and understand user needs.

Skills

AI software engineering
Python
Go
Rust
C++
LLM features
Data pipelines
Cloud-native

Tools

Python
FastAPI
TypeScript
React Native
Postgres
GCP
Terraform
Docker
Kubernetes

Job description

Culture

We treat your time as the scarce asset that it is. We respect people being heads-down and having the time to get into a flow. Distractions and context switching are things we work to minimize. We have meetings for specific purposes, and leverage async channels when appropriate.

Mash has an open and direct culture. We believe that not making a decision is a decision - and a terrible one at that. We have strong conviction and a bias for action. We can agree to disagree, and move forward after reviewing the details. As we learn, we will reevaluate, iterate and push forward.

About Mash

We're a dynamic team with experience at startups, and scaling products at big tech including Google, Amazon, Ada, D2L, CourseHero, Rakuten, Dayforce, PagerDuty, ROSS Intelligence & Lazer. We have top AI staff, including from programs such as MScAC, and advisors that have built startups and led some of the largest organizations in big-tech over the past 15 years.

We don't use any seniority titles, and plan not to for as long as feasibly possible (learn more about why).

Mash investors include Whitecap Venture Partners, Castle Island Ventures, Maple VC, Strategic Cyber Ventures, Aquanow, Spacecadet, and angel investors including Sunny Madra (formerly Groq, now NVIDIA), Balaji Srinivasan (former CTO of Coinbase, author of The Network State), Austin Hill (co-founder of Zero-Knowledge Systems and Blockstream), Josh Troy (multi-startup CFO/co-founder, including Urbint) and John Pfeffer (former partner at KKR, co-founder of Pfeffer Capital).

Role & responsibilities

As an AI-focused software engineer on the Mash team, you will:

  • Ship core AI features within the Mash platform.
    • Architect LLM-powered solutions and manage related infrastructure.
    • Apply information retrieval techniques for search and retrieval-augmented generation (RAG), working with embedding models and vector databases.
    • Develop processes and tooling for measuring and iterating on LLM output quality, leveraging eval frameworks and observability platforms.
    • Create tooling to collect and leverage internal datasets for evaluation, few-shot prompting, fine-tuning and more.
    • Develop bespoke ML/NLP models, when appropriate.
  • Build production data pipelines to ingest knowledge sources.
  • Stay up to date on cutting-edge research in the ML/NLP space and identify opportunities to apply new techniques within the Mash platform.
  • Work closely with a cross-functional team (product, design, engineering).
  • Discover and understand user needs.
Our stack
  • AI: Always iterating and changing - recently - Python, Agent Harnesses (e.g., home-brewed, open-source), Inference across open-weight and frontier LLM models, NLP models, speech-to-text, and lots more.
  • Application: Python (FastAPI, Pydantic, SQLAlchemy), TypeScript, React Native with Expo, Next.js.
  • Data: Postgres, Cloud Storage, Prefect.
  • Infrastructure: GCP (e.g., Cloud Run, Cloud SQL, Pub/Sub, Eventarc), Terraform, Docker, Dagger, Kubernetes, Tilt, OpenTelemetry.
Skill set
  • 4+ years of building production software at scale with a multi-year focus on AI.
  • Proficiency in 1+ programming languages, such as Python, Go, Rust, C++, or Java.
  • You've shipped LLM-powered features to real users: agents and tool calling, context design, retrieval and structured outputs.
  • You've built evals, datasets or regression checks that drive meaningful and provable improvement in a customer/user experience.
  • Experience with event-driven systems, building cloud-native software (with cloud providers such as Google Cloud Platform, Amazon Web Services, Microsoft Azure, etc.), working with data (both structured and unstructured) and developing data pipelines.
  • Strong understanding of backend system design and scalable architectures.
  • You use AI coding agents as a normal part of how you build.
  • Bonus: agent harnesses, structured interactions, speech or audio pipelines, entity resolution, sandboxing and isolation, privacy-preserving ML.
Cultural fit

We're looking for an individual who:

  • Responds well to open-ended problems and thrives on autonomy - is a self-starter and problem solver.
  • Thrives in collaborative environments and is laser-focused on team goals.
  • Has great communication skills.
  • Has a passion for lifelong learning.
  • Has strong user empathy, and a user experience first mindset.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product Engineer
Product Engineer

Mash • Toronto

On-site
CAD 110,000 - 160,000
MBA Intern (Startup Marketing, Ops & GTM)
MBA Intern (Startup Marketing, Ops & GTM)

Mash • Toronto

On-site
CAD 70,000 - 120,000
Member of Business Team
Member of Business Team

Mash • Toronto

On-site
CAD 70,000 - 110,000
Full Stack Engineer, Agentic AI
Full Stack Engineer, Agentic AI

Lazer Technologies • Toronto

Remote
CAD 110,000 - 150,000
Work From Anywhere
Work / Life Balance
Employee Care: healthcare, dental, etc
+2
AI Engineer
AI Engineer

Fortiv Technical Inc. • Toronto

Hybrid
CAD 160,000 - 210,000
Applied Artificial Intelligence Engineer
Applied Artificial Intelligence Engineer

ContactMonkey Inc. • Toronto

Hybrid
CAD 120,000 - 190,000
Hybrid Work
Employee Stock Options
Personal Development Budget
+5
Senior Software Engineer (Backend, AI Platform)
Senior Software Engineer (Backend, AI Platform)

Affirm, Inc. • Ottawa

Remote
CAD 120,000 - 180,000
Remote-first compensation structure
Spending Wallets for tech, food, and生活
Health benefits
+2
Artificial Intelligence Engineer
Artificial Intelligence Engineer

Professional Staffing • Toronto

On-site
CAD 140,000 - 230,000
Applied AI Engineer
Applied AI Engineer

Luxoft • Canada

On-site
CAD 120,000 - 180,000
AI Infra Engineer
AI Infra Engineer

Urban Ridge Supplies • Toronto

Remote
CAD 120,000 - 180,000
Competitive Salary
Health Insurance (US Only)
Remote Work Environment
+2