Software Engineer II - Compute

Aurora

Louisville (KY)

On-site

USD 126,000 - 201,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Annual bonus
Equity compensation
Benefits

Job summary

Aurora in Louisville, CO is seeking a senior software engineer for the Compute team to design and maintain BatchAPI, optimize the scheduler, and drive performance and scalability of a massive distributed compute fleet.

You will collaborate with Infrastructure, Data, Simulation, and ML teams, implement low-latency APIs bridging Python SDK with Go core, and contribute to reliable end-to-end testing of AV-to-Offboard systems.

Qualifications

  • 5+ years of professional software engineering experience.
  • Deep expertise in Golang (for core systems) and some knowledge of Python (for SDK/API layering).
  • Strong understanding of distributed systems fundamentals (CAP theorem, consensus algorithms, or gossip protocols).
  • Experience with performance profiling and tuning (memory management, I/O bottlenecks, or network latency optimization).
  • Specialized knowledge of container orchestration systems like Kubernetes.
  • Proven track record of driving continuous performance, scalability, and resilience improvements in production environments managing critical data.
  • Familiarity with cloud provider compute and data services (e.g., AWS EKS, S3, RDS).

Responsibilities

  • Design, implement, and maintain core components of the high-performance, large-scale distributed batch compute engine (BatchAPI). Architect and optimize the scheduler, resource allocator, and execution engine of BatchAPI to handle bursty, heterogeneous workloads with minimal overhead.
  • Design low-latency APIs and resilient communication protocols that bridge our Python SDK with the Golang-based core engine.
  • Develop high-level workflow abstractions, enabling engineers across the company to programmatically define, deploy, and manage complex data processing, simulation, and ML training pipelines.
  • Solve complex problems in distributed locking, throttling, and fair-share scheduling to ensure multi-tenant stability.
  • Drive continuous improvements in the performance, scalability, and resilience of the entire compute infrastructure, implementing robust monitoring and alerting systems to maintain operational excellence for critical workflows.
  • Collaborate closely with infrastructure and product engineering teams (e.g., Autonomy, Data, Simulation, Machine Learning) to gather requirements, provide expert consultation, and integrate compute workflows with key company systems.

Skills

Golang
Python
Distributed systems
Performance profiling
Kubernetes

Tools

AWS

Job description

Who We Are

Aurora’s mission is to deliver the benefits of self-driving technology safely, quickly, and broadly.

Who We Are

Aurora’s mission is to deliver the benefits of self-driving technology safely, quickly, and broadly. The Aurora Driver will create a new era in mobility and logistics, one that will bring a safer, more efficient, and more accessible future to everyone. At Aurora, you will tackle massively complex problems alongside other passionate, intelligent individuals, growing as an expert while expanding your knowledge. For the latest news from Aurora, visit aurora.tech or follow us on LinkedIn.

What We Are Looking For

Aurora hires talented people with diverse backgrounds who are ready to help build a transportation ecosystem that will make our roads safer, get crucial goods where they need to go, and make mobility more efficient and accessible for all. The journey to developing our cutting-edge self-driving truck Driver software requires a massive and continuous computational effort. Every day, Aurora's engineers initiate and manage millions of compute tasks, systematically processing and analyzing petabytes of critical data. This colossal computational workload spans various essential domains, including raw and derived data processing pipelines, large-scale simulations to test and validate the software in countless scenarios, and the intensive machine learning training jobs that are the core of our autonomous system's intelligence. At the heart of orchestrating this monumental computing infrastructure is the Compute team. This team is dedicated to building and maintaining the foundational technology that solves the fundamental challenges of resource scheduling, task isolation, and distributed state consistency across our massive batch compute fleet. At our scale, traditional off-the-shelf orchestrators break. The Compute team builds the custom engine - BatchAPI - that manages the lifecycle of millions of tasks - built on top of K8s primitives but implements our own custom scheduler. We deal with the 'unsolved' problems of distributed computing: maximizing hardware utilization while ensuring that a failure in one node doesn't cascade across the entire cluster. This engine is engineered to handle massive scale, ensuring reliability, efficiency, and rapid turnaround for our engineers. Furthermore, the Compute team empowers engineers across the company to run detailed, end-to-end simulation and integration tests (at scale) between “virtual vehicles” and backend services. They develop and maintain the AV to Offboard (AV2O) system. This framework provides a powerful, flexible interface that allows engineers to programmatically define, construct, deploy, monitor, and manage complex integration and simulation tests. The framework abstracts away the complexities of traditional “hardware-in-the-loop” testing, enabling engineers to rapidly iterate on difficult integration efforts, thus accelerating the entire development cycle for the Aurora Driver.

In this role you will
  • Design, implement, and maintain core components of the high-performance, large-scale distributed batch compute engine (BatchAPI). Architect and optimize the scheduler, resource allocator, and execution engine of BatchAPI to handle bursty, heterogeneous workloads with minimal overhead.
  • Design low-latency APIs and resilient communication protocols that bridge our Python SDK with the Golang-based core engine.
  • Develop high-level workflow abstractions, enabling engineers across the company to programmatically define, deploy, and manage complex data processing, simulation, and ML training pipelines.
  • Solve complex problems in distributed locking, throttling, and fair-share scheduling to ensure multi-tenant stability.
  • Drive continuous improvements in the performance, scalability, and resilience of the entire compute infrastructure, implementing robust monitoring and alerting systems to maintain operational excellence for critical workflows.
  • Collaborate closely with infrastructure and product engineering teams (e.g., Autonomy, Data, Simulation, Machine Learning) to gather requirements, provide expert consultation, and integrate compute workflows with key company systems.
Required Qualifications
  • 5+ years of professional software engineering experience.
  • Deep expertise in Golang (for core systems) and some knowledge of Python (for SDK/API layering).
  • Strong understanding of distributed systems fundamentals (e.g., CAP theorem, consensus algorithms, or gossip protocols).
  • Experience with performance profiling and tuning (e.g., memory management, I/O bottlenecks, or network latency optimization).
  • Specialized knowledge of container orchestration systems like Kubernetes.
  • Proven track record of driving continuous performance, scalability, and resilience improvements in production environments managing critical data.
  • Familiarity with cloud provider compute and data services (e.g., AWS EKS, S3, RDS).
Desirable Qualifications
  • Experience working with computational workloads specific to the autonomous vehicle, robotics, or large-scale machine learning domains (e.g., data processing for perception, simulation, or model training).
  • Demonstrated ability in creating and refining user-facing tools, including adeptness at incorporating user feedback, managing expectations, and effectively prioritizing development based on user needs.
  • Web UI development experience (Typescript, React)

For roles based in Louisville, CO: The salary range for this position is $126,000 - $201,000 per year.

Aurora’s pay ranges are determined by role, level, and location. Within the range, the successful candidate’s starting base pay will be determined based on factors including job-related skills, experience, qualifications, relevant education or training, and market conditions. These ranges may be modified in the future. The successful candidate will also be eligible for an annual bonus, equity compensation, and benefits.

Working at Aurora

At Aurora, we bring together extraordinarily talented and experienced people united by the strength of our values. We operate with integrity, set outrageous goals, and build a culture where we win together — all without any jerks. We believe in-person work increases collaboration, empathy, and our ability to lead effectively. As a result, Aurorans are expected to work from the office at least 3 days per week, with some roles requiring more frequent in-office presence, up to 5 days per week, based on operational needs. Our Careers page provides insight into what it is like to work at Aurora, and you can find all the latest updates in our Newsroom.

Our commitment to safety

At the core of everything we do is our commitment to safety. Building best-in-class self-driving technology will take time, and we believe that each employee at Aurora has a role in contributing to safety, every step of the way. Aurora expects commitment to our safety policies from every employee, and seeks candidates who take an active responsibility, can contribute to building an atmosphere of trust, and invest in the organization’s long-term success by prioritizing working safely, no matter what.

Our commitment to inclusion

Aurora considers candidates without regard to their race, color, religion, national origin, age, sex, gender, gender identity, gender expression, sexual orientation, marital status, pregnancy status, parent or caregiver status, ancestry, political affiliation, veteran and/or military status, physical or mental disability, or any other status protected by federal or state law. Aurora considers qualified applicants with criminal histories, consistent with applicable federal, state, and local law. We are also committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at careersiteaccommodations@aurora.tech.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer II - Compute
Software Engineer II - Compute

Aurora Innovation • Louisville (CO)

On-site
USD 126,000 - 201,000
Annual bonus
Equity compensation
Benefits
Software Engineer II - Compute
Software Engineer II - Compute

Aurora • Louisville (KY)

On-site
USD 126,000 - 201,000
Annual bonus
Equity compensation
Benefits
Software Engineer II - Compute
Software Engineer II - Compute

Aurora • Louisville (CO)

On-site
USD 126,000 - 201,000
Annual bonus
Equity compensation
Benefits
Staff Software Engineer - Frameworks
Staff Software Engineer - Frameworks

Aurora • Seattle (WA)

On-site
USD 189,000 - 303,000
Annual bonus
Equity compensation
Benefits package
Software Engineer II, Pipeline Automation & Acceleration
Software Engineer II, Pipeline Automation & Acceleration

Aurora • Mountain View (CA)

Hybrid
USD 139,000 - 223,000
Staff Software Engineer, Deep Learning Acceleration
Staff Software Engineer, Deep Learning Acceleration

Aurora • San Francisco (CA)

Hybrid
USD 189,000 - 274,000
Annual bonus
Equity compensation
Hybrid work environment
Staff Software Engineer
Staff Software Engineer

Aurora • Pittsburgh

Hybrid
USD 171,000 - 273,000
Staff Software Engineer - Frameworks
Staff Software Engineer - Frameworks

Life in Pittsburgh • Pittsburgh, Seattle (WA), Mountain View (CA), San Francisco (CA)

Hybrid
USD 171,000 - 273,000
Software Engineer, Behavior Planning ML Platform
Software Engineer, Behavior Planning ML Platform

Aurora • Pittsburgh

Hybrid
USD 126,000 - 181,000
Staff Software Engineer - Frameworks
Staff Software Engineer - Frameworks

Aurora • Mountain View (CA)

On-site
USD 189,000 - 303,000