Software Dev Engineer

Amazon.com

Toronto

On-site

CAD 107,000 - 130,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amazon Inc. in Toronto, Ontario is seeking a software engineer to develop and optimize software for ML accelerator silicon. You will collaborate with hardware, firmware, and ML engineers to create scalable, high-performance software across the accelerator stack.

The role requires experience with C/C++, Python or Rust, and familiarity with compiler design, device drivers, Linux kernel, and ML frameworks such as PyTorch or TensorFlow. Strong collaboration and on-call readiness are expected.

Qualifications

  • Currently pursuing or holding a Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or related STEM field
  • Proficiency in at least one programming language such as C, C++, Python, Rust, or Java
  • Experience with data structures, algorithms, systems programming, or OO design principles

Responsibilities

  • Collaborate with cross-disciplinary teams to develop software for ML accelerator silicon
  • Design, develop, and test software across the accelerator stack including toolchains and drivers
  • Build scalable systems supporting chip verification and ML workloads
  • Write clean, maintainable code in C, C++, Python, or Rust
  • Develop CI/CD pipelines, test automation, and tooling for hardware-software co-development
  • Participate in code reviews, contribute to documentation, and leverage GenAI tools
  • Demonstrate operational excellence through monitoring, debugging across hardware-software boundaries
  • Stay current with ML accelerators, compiler optimization, architecture, and cloud-scale systems

Skills

C
C++
Python
Rust
Java
Compiler design
Optimization
Computer architecture
Device drivers
Linux kernel
Embedded systems
ML frameworks
PyTorch
TensorFlow
Performance profiling
Cloud platforms (AWS)
Version control (Git)

Education

Bachelor's degree in Computer Science or Electrical/Computer Engineering

Tools

Linux kernel
AWS
PyTorch
TensorFlow
Git

Job description

Are you passionate about innovation? Do you want to solve real customer problems through innovative technology? Do you enjoy working on scalable projects in a collaborative team environment? Do you want to see your solutions directly impact millions of customers worldwide? At Amazon, we hire the best minds in technology to innovate and build on behalf of our customers. Customer obsession is part of our company DNA, which has made us one of the world's most beloved brands. We're looking for curious minds who think big and want to define tomorrow's technology. At Amazon, you'll grow into the high-impact contributor you know you can be, supported by a culture of learning and mentorship. Every day brings exciting new challenges and opportunities for personal growth.

Key job responsibilities
  • Collaborate with cross-disciplinary teams that may include hardware design, firmware, compiler, runtime, and ML engineers to develop software that enables and optimizes custom ML accelerator silicon
  • Design, develop, and test software across the accelerator stack, including compiler toolchains, device drivers, runtime libraries, profiling tools, simulation frameworks, or chip validation infrastructure
  • Build scalable, high-performance systems supporting chip verification, silicon bring-up, or production ML inference/training workloads
  • Write clean, maintainable code (C, C++, Python, or Rust) following best practices for systems-level and performance-critical development
  • Develop CI/CD pipelines, test automation, and tooling to accelerate the hardware-software co-development lifecycle
  • Participate in code reviews, contribute to technical documentation, and leverage GenAI tools to enhance development productivity
  • Demonstrate operational excellence through monitoring, debugging, and resolving issues across hardware-software integration boundaries, including on-call responsibilities
  • Stay current with emerging technologies in ML accelerators, compiler optimization, computer architecture, and cloud-scale distributed systems

A day in the life As an Amazonian, you will be matched to a manager and a team, and will have the opportunity to influence the evolution of Amazon technology and work on critical projects early in your career. In addition to working on impactful projects, you will have the opportunity to engage with Amazonians for both personal and professional development, expand your network, and participate in various activities. We give you the tools to own your projects and learn in a real-world settings.

Basic Qualifications
  • Currently has, or is in the process of obtaining a Bachelor's degree or above in Computer Science, Computer Engineering, Electrical Engineering, or related STEM field
  • Demonstrated experience with at least one programming language such as C, C++, Python, Rust, or Java
  • Demonstrated experience with one or more of the following: data structures, algorithm development, systems programming, or object-oriented design principles
Preferred Qualifications
  • Previous technical internship(s) or demonstrated project experience in systems software, hardware-adjacent development, or ML infrastructure
  • Experience with one or more of the following: compiler design or optimization, computer architecture, device drivers or low-level systems programming, hardware simulation or emulation, ML frameworks (PyTorch, TensorFlow), performance profiling and analysis, Linux kernel or embedded systems, AI tools for development productivity, cloud platforms (preferably AWS), version control systems
  • Strong problem-solving skills with ability to debug across hardware-software boundaries
  • Excellent written and verbal communication skills
  • Basic understanding of the hardware development lifecycle (RTL design, verification, silicon bring-up, production deployment)
  • Demonstrated ability to learn and adapt to new technologies quickly

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.

Toronto, ON, CAN - 118,600.00 CAD Annually

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Developer Engineer
Software Developer Engineer

Amazon Inc. • Toronto

On-site
CAD 107,000 - 130,000
Software Dev Engineer
Software Dev Engineer

Teamblind, Inc. • Toronto

On-site
CAD 110,000 - 170,000
Software Dev Engineer, Machine Learning Compilers, Edge AI Compiler and Runtime Team
Software Dev Engineer, Machine Learning Compilers, Edge AI Compiler and Runtime Team

Amazon Inc. • Vancouver

On-site
CAD 115,000 - 192,000
Senior ML Kernel Performance Engineer
Senior ML Kernel Performance Engineer

Amazon Inc. • Toronto

On-site
CAD 151,000 - 252,000
Health insurance
RRSP and benefits
Senior ML Kernel Performance Engineer
Senior ML Kernel Performance Engineer

Ml Jobs • Toronto

On-site
CAD 151,000 - 252,000
Health insurance
RRSP
DPSP
+2
ML Accelerator Software Engineer
ML Accelerator Software Engineer

Amazon Inc. • Toronto

On-site
CAD 107,000 - 130,000
ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs
ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) • Toronto

On-site
CAD 115,000 - 192,000
Health insurance (medical, dental, vis
RRSP
Deferred Profit Sharing Plan (DPSP)
+1
ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs
ML Kernel Performance Engineer, AWS Neuron, Annapurna Labs

Ml Jobs • Toronto

On-site
CAD 115,000 - 192,000
Health insurance
RRSP/retirement plan
Paid time off
Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs
Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) • Toronto

On-site
CAD 214,000 - 358,000
Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs
Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna Labs

Amazon • Toronto

On-site
CAD 214,000 - 358,000
Health insurance
RRSP
Paid time off