Senior/Staff Software Engineer, Infrastructure (ML) San Francisco, CA

Nimble; San Francisco, Northern (CA, KY); Hybrid; USD 210,000 - 300,000; Full time

Benefits offered by this job

Unlimited Flexible Time Off

Health Insurance

Equity

401k

Referral Bonus

Parking

Job summary

Nimble is hiring a Senior/Staff Software Engineer for its ML Infrastructure team to build and optimize training and inference systems powering autonomous warehouse robots. You will own end-to-end training infrastructure, maximize GPU utilization, and enable researchers to launch new experiments with a single command.

You will collaborate with ML and Robotics teams, scale GPU clusters, and contribute to robust, low-latency pipelines and high-throughput data workflows.

Qualifications

• PhD/masters/BS with equivalent experience in CS or related field.
• 4+ years in infrastructure, distributed systems, ML systems or robotics.
• Experience with Rust, Go, Python, or C++.
• Experience with PyTorch or JAX.
• Strong distributed systems fundamentals, memory management and performance tuning.
• Experience with Kubernetes orchestration and data-heavy distributed jobs.
• Ability to debug across GPU memory, networking, filesystems, and multi-GPU setups.
• Strong cross-functional communication and growth mindset.

Responsibilities

• Design, develop and maintain ML training infrastructure for efficient experiments.
• Build low-latency inference pipelines for production robotics workloads.
• Develop, tune and optimize CUDA kernels.
• Design scalable training platforms with high-throughput data ingestion and distribution.
• Lead design reviews and evaluate technology tradeoffs.
• Review code for quality, tests and performance; mentor engineers.

Skills

Rust

Go

Python

C++

PyTorch

JAX

Kubernetes

Distributed systems

GPU memory management

Education

Bachelor’s, Master’s, or PhD in Computer Science or related field

Tools

PyTorch DDP/FSDP

DeepSpeed

Megatron

NCCL

CUDA

Arrow/Parquet

Job description

Senior/Staff Software Engineer, Infrastructure (ML)

About Nimble

Nimble is an AI robotics company building the autonomous supply chain to power fast, efficient and economical commerce. We’re training robot AGI to power a proprietary generalist supply chain superhumanoid, the first robot in the world capable of performing thousands of tasks across the supply chain. We’ve raised over $220M at over $1B valuation and formed a strategic alliance with FedEx to build a national network of autonomous warehouses capable of generating many billions in annual revenue. We are a hardcore and obsessed team of the world’s best engineers and operators. If you are obsessed with your craft, enjoy a high-intensity and fast moving high impact environment, are super high agency in getting hard things done and want to be part of building the world’s most legendary robotics company at the most pivotal moment in history, we want to work with you.

We are on a mission to empower and inspire mankind to accomplish legendary feats by inventing robots that liberate us from the menial. We will accomplish this by training robot AGI to invent and build the Autonomous Supply Chain – everything from the inside of factories and warehouses to your front door – powered by generalist superhumanoids.

Our founding team comes from the AI labs at Stanford and Carnegie Mellon and our board of directors include famed robotics and AI legends including Fei-Fei Li (Chief Scientist of AI at Google and Director of Stanford’s AI Lab), Marc Raibert (founder of Boston Dynamics), and Sebastian Thrun (founder of GoogleX, Waymo; Stanford Professor and considered the father of autonomous vehicles).

Let’s be legendary.

Why Join Nimble?

At Nimble, we are committed to building legendary products, a legendary team, and a legendary legacy. Join us and become part of an ambitious, humble, and resourceful culture where your work will leave a lasting impact on the future of robotics and commerce.

Nimble's Core Values:

Be relentlessly resourceful-Challenge conventions and overcome obstacles.

Be legendary-Be the very best and do work that inspires.

Be humble-Prioritize growth, learning, and doing whatever is needed to further the mission.

Be dependable-Take ownership and deliver with high agency.

About the Role

We’re looking for a Software Engineer to join our ML Infrastructure team. In this role, you’ll help build the training and inference systems that power our general-purpose warehouse robots.

You’ll own training infrastructure end to end: keeping GPUs highly utilized, making runs reproducible, and ensuring every researcher can launch the next experiment with a single command. You’ll work closely with ML and Robotics teams to design, build, and scale the systems that turn our GPU clusters into a reliable, high-throughput platform for model development.

Responsibilities

• Design, develop, and maintain ML training infrastructure that enables the AI team to run training jobs efficiently, manage and iterate experiments quickly.
• Build low-latency inference pipelines for production robotics workloads.
• Develop, tune, and optimize low-level CUDA kernels.
• Design training-platform systems for scalable model training, including high-throughput data ingestion, dataset sharding and sampling for distributed training.
• Participate in and lead design reviews with peers and stakeholders to evaluate technical tradeoffs and select appropriate technologies.
• Review code and provide feedback to uphold best practices around style, correctness, testability, performance, and maintainability.
• Contribute to documentation and educational materials, adapting content as systems and workflows evolve.
• Mentor junior engineers and help raise the technical bar across the team.

Qualifications

• Bachelor’s, Master’s, or PhD in Computer Science or a related field, or equivalent practical experience.
• 4+ years of industry experience in infrastructure, distributed systems, ML systems, robotics, or a related area.
• Experience with programming languages such as Rust, Go, Python, or C++.
• Experience with ML frameworks such as PyTorch or JAX.
• Strong understanding of distributed systems, systems programming fundamentals, memory management, and performance optimization.
• Experience with Kubernetes orchestration, resource scheduling for large distributed jobs, and containerized deployment pipelines.
• Ability to debug and optimize bottlenecks across GPU memory hierarchy, networking fabric, filesystems, and multi-GPU operations.
• Ability to reason from first principles and optimize systems for both memory-bound and compute-bound workloads.
• Strong cross-functional communication skills, ownership, and a growth mindset.

Nice to Have

• Hands-on experience with distributed training frameworks and techniques such as PyTorch DDP/FSDP, DeepSpeed, Megatron, or NCCL.
• Hands-on experience with GPU kernel development.
• Experience with data engineering technologies such as Parquet, Arrow, or similar systems.

Compensation

The pay range for this position at the start of employment is expected to be between $210,000 and $300,000/year. Your exact offer may vary depending on multiple individualized factors, including job-related knowledge, skills, and experience. In addition to cash compensation, this position will also receive generous equity for this position.

Culture:

We embrace challenges and strive to make the impossible possible each day. We’re not in this to do what’s easy or to be mediocre. We want to create something legendary and leave our mark on the world. We’re ambitious, we’re gritty, we’re humble and we’re relentlessly resourceful in pursuit of our goals. If this sounds like you then you might be a great fit!

Nimble Robotics, Inc. is an equal opportunity employer. We make all employment decisions based solely on merit. We provide equal employment opportunity to all applicants and employees without discrimination on the basis of race, color, religion, national origin, ancestry, disability, medical condition, genetic information, marital status, sex, gender, gender identity, gender expression, sexual orientation, age, military or veteran status, or any other characteristic protected by applicable state, federal or local laws.

Nimble's Benefits

Unlimited Flexible Time Off

Enjoy the time you need to travel, rejuvenate, and connect with friends and family.

Health Insurance

Nimble provides medical, dental, and vision insurance through several premier plans and options to support you and your family.

Enjoy paid bonding time following a birth.

Take the stress out of commuting with access to fully-paid parking spots.

Referral Bonus

Get a cash bonus for any friend or colleagues that you refer to us that we end up hiring.

401k

Contribute towards a 401k for retirement planning.

Equity

Be an owner in Nimble through our equity program