Senior Software Engineer, Evaluation Infrastructure

Waabi; Toronto; On-site; CAD 176,267 - 309,508; Full time

Benefits offered by this job

Competitive compensation and equity awards

Health and Wellness benefits

Unlimited Vacation

Flexible hours and Work from Home support

Daily drinks, snacks and catered meals

Team building activities and social events

Job summary

A cutting-edge technology startup is seeking a talented individual to join their Evaluation Algorithms team in Toronto. You will play a crucial role in developing the tools and infrastructure for evaluating the performance of autonomous systems. Ideal candidates possess a strong background in Python and statistical analysis. The role offers a competitive salary range of $127,000 - $223,000 USD, along with benefits including unlimited vacation and flexible work arrangements.

Qualifications

• Minimum 2 years of industry experience in relevant technical fields.
• Experience writing well-structured, high-quality code.
• Willingness to engage and collaborate with team members.

Responsibilities

• Develop tooling and infrastructure for statistical analyses.
• Implement metrics for model performance understanding.
• Maintain high availability query services for data analysis.
• Work with large datasets for evaluation.
• Champion engineering excellence through code quality.
• Assist in project planning and delivery.

Skills

Python programming

Statistical analysis

Collaboration

Problem-solving

Education

MS/Bachelor's degree in Computer Science or related field

Tools

Data processing pipelines

ETL pipelines

Distributed computing

Job description

Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world‑class team, we're unlocking the next era of autonomous transportation with technology that's powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.

With offices in Toronto, San Francisco, Dallas, and Pittsburgh, Waabi is growing quickly and looking for diverse, innovative and collaborative candidates who want to impact the world in a positive way. To learn more visit: www.waabi.ai

The Evaluation Algorithms team is responsible for building the algorithms & tooling required to comprehensively evaluate our autonomy system’s performance across all development stages. In this role, you will work closely with the systems & safety teams, responsible for defining the requirements & evaluation criteria, and simulation teams to leverage Waabi World, our highly realistic closed-loop simulation engine built with the latest in generative AI technologies to deliver the evaluation capabilities needed to support the safe development of the next generation of autonomous vehicles!

You Will

• Develop the tooling, infrastructure, and pipelines to support complex statistical analyses of driving performance scale.
• Implement metrics and tags to provide a holistic understanding of model performance and enable the discovery of interesting scenarios for training and evaluation.
• Develop and maintain a high availability query service to enable low‑latency analysis and curation over large volumes of metric and tag data.
• Work with large datasets from various sources including real world driving as well as Waabi World, our high‑fidelity simulator.
• Champion engineering excellence, ensuring high‑quality, well structured and tested code.
• Assist in project roadmap planning, prioritisation, and delivery.

Qualifications

• MS/Bachelors degree with 2+ years of industry experience in Computer Science, Machine Learning and/or similar technical field(s) of study.
• Proficient in Python programming and strong software engineering fundamentals with real‑world experience writing high quality, well‑structured, and well‑tested code.
• Open‑minded and collaborative team player with the willingness to help others.
• Passionate about self‑driving technologies, solving hard problems, and creating innovative solutions.

Bonus Points

• Experience in data processing pipelines, ETL pipelines, distributed computing.
• Experience in building highly reliable and scalable web services.
• Understanding of cloud job orchestration, monitoring, and instrumentation best‑practices.
• Experience in evaluating complex ML models or self‑driving software stacks.

The US yearly salary range for this role is: $127,000 - $223,000 USD in addition to competitive perks & benefits. Waabi (US) Inc.’s yearly salary ranges are determined based on several factors in accordance with the Company’s compensation practices. The salary base range is reflective of the minimum and maximum target for new hire salaries for the position across all US locations. Note: The Company provides additional compensation for employees in this role, including equity incentive awards and an annual performance bonus.

Perks/Benefits

• Competitive compensation and equity awards.
• Health and Wellness benefits encompassing Medical, Dental and Vision coverage (for full‑time employees only).
• Unlimited Vacation.
• Flexible hours and Work from Home support.
• Daily drinks, snacks and catered meals (when in office).
• Regularly scheduled team building activities and social events both on‑site, off‑site & virtually.
• As we grow, this list continues to evolve!

Waabi is a technology start‑up building technologies to transform the way the world moves. Join our talented team to be a part of the future and to make an impact!

Waabi is an equal opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all our employees. We seek applicants of all backgrounds and identities, across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law. We make workplace accommodations for qualified individuals with disabilities as required by applicable law. If reasonable accommodation is needed to participate in the job application or interview process please let our recruiting team know.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.