Inference & GPU Kernel Engineer

Touchdown Labs, Inc.

Santa Clara (CA)

On-site

USD 200,000 - 270,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Touchdown Labs is hiring an Inference & GPU Kernel Engineer in Santa Clara, CA to accelerate customer models with faster, cheaper outputs. You’ll profile workloads, identify bottlenecks, and optimize serving configurations, including GPU kernels when gains justify them.

You should bring deep GPU programming experience, strong proficiency in C++ and Python, and hands-on work with CUDA, Triton, or HIP. Knowledge of NVIDIA/AMD accelerators and benchmarking discipline is highly valued.

Qualifications

  • Profiling and bottleneck analysis of AI workloads.
  • Serving configuration and optimization for inference deployments.
  • Experience writing or tuning GPU kernels when beneficial.
  • Evidence of improved inference or training performance with profilers.

Responsibilities

  • Profile customer workloads and identify bottlenecks.
  • Implement serving configuration optimizations.
  • Develop GPU kernels when gains justify them.

Skills

GPU programming
Profiling
C++
Python

Tools

CUDA
Triton
HIP

Job description

Careers · Forward deployed & AI platform# Inference & GPU Kernel EngineerMake customer models faster and cheaper per useful output.**Location:** Santa Clara, CAAll roles →Apply for this role →---SeniorSanta ClaraOpenings: 1–2Open role## Inference & GPU Kernel Engineer### Our missionAI is becoming fundamental to how the world works. When it is, the ability to compute, and to manufacture the hardware that computes, should not be concentrated in a few places. Touchdown's mission is to make compute accessible to the whole world and to reindustrialize advanced semiconductor manufacturing in the United States. We co-design everything for next-generation compute: the AI systems people use, the software that serves them, the architectures and chips underneath, and the packaging, test, and manufacturing that make them real. Co-design brings down the complexity and cost of building compute. That is what makes manufacturing in America competitive again, and what puts compute within reach of people and companies everywhere. We build alongside the world's best manufacturing ecosystems, including Taiwan's, and every role here makes one layer better and carries what it learns to the rest.### Why this role mattersInference is where most AI compute is spent. Making it faster and cheaper per useful output is the clearest proof of what co-design across software and hardware can do.### Technical scopeProfiling and bottleneck analysis; serving configuration (batching, KV cache management, speculative decoding, quantization); GPU kernels in CUDA, Triton, or HIP; memory and interconnect behavior; benchmark design with accuracy guards; NVIDIA and AMD accelerators.### First 90 days* Profile customer workloads and name bottlenecks with traces.* Ship measured improvements with reproducible benchmarks.* Hand off so customer teams keep the gains.### What you will own* Profiling and bottleneck analysis.* Serving configuration and optimization.* GPU kernels when the gain justifies them.### What you bring* GPU programming or inference-systems depth.* Profilers and benchmark discipline.* C++ and Python.* Has improved inference or training performance with profiler evidence.* Has written or tuned CUDA, Triton, or HIP kernels.### Helpful experience* NVIDIA and AMD accelerators### How we work* AI-native by default. You use coding agents, AI-assisted analysis, and automation every day, and you check their output against measurements before anyone relies on it.* We work alongside foundries, test houses, OSATs, and research labs, and we build with partners rather than against them.### How the role works* Full-time.* Location: Santa Clara, CA.* Openings: 1–2.* Pay: $200,000–$270,000 base (Santa Clara, CA).* Ranges are base pay for U.S. roles and depend on location, experience, and level. Full-time roles also include equity and benefits. Taiwan pay is set to the local market and discussed in the first call.* Start date and employment details are discussed during the process.Apply for this role →Applications are reviewed against the work described here. We do not use a degree, title, or keyword list as a substitute for evidence.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Solutions Architect, AI Infrastructure
Solutions Architect, AI Infrastructure

Touchdown Labs, Inc. • Santa Clara (CA)

On-site
USD 150,000 - 195,000
Equity
Benefits
Forward Deployed Engineer
Forward Deployed Engineer

Touchdown Labs, Inc. • Santa Clara (CA)

On-site
USD 160,000 - 225,000
Equity
Benefits
Engineering Manager, Deep Learning Inference
Engineering Manager, Deep Learning Inference

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000
Equity
Benefits
Hybrid work arrangement
Staff Inference Engineer
Staff Inference Engineer

Uniphore • Palo Alto (CA)

On-site
USD 190,000 - 240,000
Annual incentive
Pre-IPO stock options
Medical, dental, vision
+2
Hardware Compiler Engineer
Hardware Compiler Engineer

Touchdown Labs, Inc. • Santa Clara (CA)

On-site
USD 185,000 - 245,000
Software Engineer, GPU Kernels
Software Engineer, GPU Kernels

River AI • Palo Alto (CA)

On-site
USD 200,000 - 420,000
Equity
Visa sponsorship
Relocation assistance
+1
Forward Deployed Engineering Lead
Forward Deployed Engineering Lead

Touchdown Labs, Inc. • Santa Clara (CA)

On-site
USD 210,000 - 270,000
Equity
Benefits
Member of Technical Staff, GPU Kernels
Member of Technical Staff, GPU Kernels

San Francisco Tensor Company • San Francisco (CA)

On-site
USD 285,000 - 315,000
Relocation assistance
Equity
AI Systems Acceptance Engineer
AI Systems Acceptance Engineer

Touchdown Labs, Inc. • Santa Clara (CA)

On-site
USD 145,000 - 185,000
Senior Systems Software Engineer, Compute Stack Acceleration
Senior Systems Software Engineer, Compute Stack Acceleration

NVIDIA Corporation • Santa Clara (CA)

Hybrid
USD 184,000 - 357,000