Machine Learning Infrastructure Engineer Intern

Plus 2; Santa Clara (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Free lunch

Snacks & drinks

401(k) plan

Job summary

PlusAI in Silicon Valley seeks a highly skilled systems/performance engineer to optimize BEV model training pipelines and GPU kernels. You will profile, implement custom kernels with CUDA or Triton, and push performance through LLM-assisted code generation and profiling workflows.

Key focus areas include memory management, PyTorch custom ops, and GPU utilization, with opportunities to influence autonomous vehicle perception workloads and high-performance computing practices.

Responsibilities

• Identify Training Bottlenecks: Profile BEV model training pipelines to pinpoint computational and memory bottlenecks.
• Develop Custom Kernels: Design and implement high-performance kernels using CUDA, Triton, or C++ to accelerate training.
• Leverage LLMs for Optimization: Explore and integrate LLMs to generate high-performance code and optimize kernel logic.
• Automate Profiling Workflows: Build systems to automate performance profiling with NVIDIA Nsight and PyTorch Profiler.
• Iterative Performance Tuning: Analyze profiling data to maximize GPU utilization and reduce training times.
• Systems Programming: Strong proficiency in C++ with memory management and parallel processing principles.
• Deep Learning Frameworks: Hands-on PyTorch experience with custom operations and autograd.
• Performance-Oriented Mindset: Problem-solving with a focus on low-level optimization.
• GPU Programming Experience: Experience writing and optimizing custom GPU kernels with CUDA or Triton.
• Hardware Profiling Tools: Familiarity with profiling tools like Nsight and PyTorch Profiler.
• LLM for Code Generation: Experience with LLMs for code writing or refactoring.
• Autonomous Vehicle Perception: Understanding BEV models and 3D perception.

Job description

Overview

PlusAI is a Physical AI company pioneering AI-based virtual driver software for factory-built autonomous trucks. Headquartered in Silicon Valley with operations in the United States and Europe, Plus was named by Fast Company as one of the World’s Most Innovative Companies. Partners including TRATON GROUP’s Scania, MAN, and International brands, Hyundai Motor Company, Iveco Group, Bosch, and DSV are working with Plus to accelerate the deployment of next-generation autonomous trucks. If you’re ready to make a huge impact and drive the future of autonomy, Plus is looking for talented individuals to join its fast-growing teams.

Responsibilities

• Identify Training Bottlenecks: Profile and analyze Bird\'s Eye View (BEV) model training pipelines to pinpoint computational and memory bottlenecks.
• Develop Custom Kernels: Design and implement high-performance custom compute kernels using CUDA, Triton, or C++ to accelerate the model training process.
• Leverage LLMs for Optimization: Explore and integrate Large Language Models (LLMs) to assist in generating high-performance code and optimizing kernel logic.
• Automate Profiling Workflows: Build systems to automate performance profiling and analysis using tools like NVIDIA Nsight and the PyTorch Profiler.
• Iterative Performance Tuning: Continuously analyze profiling data generated by both human and LLM-assisted workflows to maximize GPU utilization and reduce training times.
• Systems Programming: Strong proficiency in C++ and a solid understanding of memory management, computer architecture, and parallel processing principles.
• Deep Learning Frameworks: Hands-on experience with PyTorch, specifically understanding custom operations, autograd, and training loops.
• Performance-Oriented Mindset: Strong problem-solving skills with a deep interest in performance tuning, algorithmic efficiency, and low-level system optimization.
• GPU Programming Experience: Practical experience writing and optimizing custom GPU kernels using CUDA or OpenAI Triton.
• Hardware Profiling Tools: Familiarity with hardware and software profiling tools, particularly NVIDIA Nsight (Systems/Compute) and the PyTorch Profiler.
• LLM for Code Generation: Experience using or prompting LLMs for code writing, refactoring, or exploring AI-assisted software development workflows.
• Autonomous Vehicle Perception: A foundational understanding of Bird\'s Eye View (BEV) models, 3D perception, or spatial transformers used in autonomous driving.

Your opportunities joining PlusAI

Work, learn and grow in a highly future-oriented, innovative and dynamic field.

Wide range of opportunities for personal and professional development.

Catered free lunch, unlimited snacks and beverages.

Highly competitive salary and benefits package, including 401(k) plan.