GPU Engineer

Bot Auto; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Bot Auto in San Francisco hires a highly skilled GPU software engineer to optimize real-time autonomous driving workloads. You will work on sensor processing, neural network inference, and GPU-accelerated components using CUDA, with a focus on low-latency embedded platforms.

The role requires strong C/C++ and Python proficiency, experience with Nsight tools, and prior work on real-time embedded systems and large sensor data streams.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
• Strong knowledge of parallel computing principles, GPU architecture, memory hierarchy, and performance optimization techniques.
• Experience profiling GPU applications using tools such as NVIDIA Nsight Systems, Nsight Compute, or equivalent tools.
• Experience deploying or optimizing neural network inference workloads using PyTorch, ONNX, and TensorRT.
• Experience with real-time embedded systems and handling large data streams from sensors (camera, LiDAR, radar).
• Strong proficiency in C/C++ and Python.

Responsibilities

• Optimize end-to-end GPU performance for real-time autonomous driving workloads, including sensor processing and NN inference.
• Develop and optimize parallel computing algorithms and GPU-accelerated components using CUDA.
• Collaborate with cross-functional teams to design onboard GPU software architectures for perception, planning, and control modules.
• Profile and analyze bottlenecks across GPU computation, memory access, data movement, synchronization, and CPU–GPU interaction.
• Debug and optimize GPU-based software to improve latency, throughput, resource utilization, and runtime stability on embedded platforms.

Skills

GPU programming

CUDA

Nsight tools

Neural network inference

C/C++

Python

Embedded systems

Education

Bachelor’s or Master’s degree in Computer Science or Electrical Engineering

Tools

NVIDIA Jetson Thor

NVIDIA DRIVE Thor

MPS

MIG

Job description

Company Introduction

At Bot Auto, we are revolutionizing the transportation of goods with our cutting-edge autonomous trucks, enhancing the quality of life for communities around the globe. With the agility of a start-up and the wisdom of seasoned experts, Bot Auto boasts a team that has achieved numerous world-firsts and unparalleled innovations. United by a shared vision, we create miracles and propel the future of transportation. Join us and transform your dreams into reality.

You would collaborate with software engineers, AI researchers, and hardware specialists to develop high-performance solutions that meet the stringent requirements of autonomous driving applications. This is an exciting opportunity to work on next-generation transportation technology and make a meaningful impact on the future of mobility.

Key Responsibilities

• Optimize end-to-end GPU performance for real-time autonomous driving workloads, including sensor processing (e.g., camera, LiDAR) and neural network inference.
• Develop and optimize parallel computing algorithms and GPU-accelerated components using technologies such as CUDA.
• Collaborate with cross-functional teams to design and improve onboard GPU software architectures that meet the computational requirements of perception, planning, and control modules.
• Profile and analyze bottlenecks across GPU computation, memory access, data movement, synchronization, and CPU–GPU interaction.
• Debug and optimize GPU-based software to improve latency, throughput, resource utilization, and runtime stability on embedded platforms.

Qualifications

Required:

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related field.
• Strong knowledge of parallel computing principles, GPU architecture, memory hierarchy, and performance optimization techniques.
• Experience profiling GPU applications using tools such as NVIDIA Nsight Systems, Nsight Compute, or equivalent tools.
• Experience deploying or optimizing neural network inference workloads using technologies such as PyTorch, ONNX, and TensorRT.
• Experience with real-time embedded systems and handling large data streams from sensors (camera, LiDAR, radar).
• Strong proficiency in C/C++ and Python.

Preferred

• 3+ years of experience in GPU programming and optimization (e.g., CUDA, OpenCL, Vulkan).
• Experience with NVIDIA Jetson Thor, NVIDIA DRIVE Thor, or similar embedded GPU platforms.
• Experience with model quantization, including FP8 and NVFP4.
• Experience managing concurrent GPU workloads and resource isolation using technologies such as NVIDIA Multi-Process Service (MPS), Multi-Instance GPU (MIG), or other related technologies.
• Experience with GPU-accelerated sensor data compression, including camera, LiDAR, or other onboard sensor data.