Member of Technical Staff, Kernel Performance & Automation

Ashby, Inc.

Palo Alto (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Highly competitive salary and equity
Comprehensive health coverage for you/

Job summary

Inco AI is seeking a founding engineer to own kernel-level performance across our inference stack, identifying bottlenecks, fusing GPU kernels, and pushing improvements to production on traditional GPUs or custom accelerators.

This hands-on role has broad ownership with no middle layer; you set direction, work across hardware-software boundaries, and ship high-impact performance gains.

Strong preference for in-person work in Palo Alto or Brooklyn, with a highly competitive salary and equity.

Qualifications

  • Deep expertise in GPU and hardware performance optimization.
  • Hands-on low-level GPU kernel programming with CUDA, Triton, or PTX.
  • Experience optimizing inference via kernel fusion, quantization, speculative decoding, or sparsity.
  • Proficiency with profiling and tracing tools (Nsight Systems and Nsight Compute).
  • Working knowledge of modern LLM and multimodal model architectures.
  • Experience optimizing kernels and communication for LLMs on modern GPU systems like B300 and GB300 NVL72.

Responsibilities

  • Own kernel-level performance across the inference stack.
  • Identify bottlenecks and fuse GPU kernels to improve throughput and latency.
  • Automate kernel optimization using agents and related tooling.
  • Define projects from first principles across hardware–software boundaries and pursue impactful performance gains.
  • Ship improvements to production with minimal management layers and clear direction.

Skills

GPU performance
Kernel programming
Kernel fusion
Profiling tools
LLM architectures
Custom accelerators

Tools

CUDA
Triton
PTX
Nsight Systems
Nsight Compute
CuTe DSL
CUTLASS
cuBLAS
NCCL
KDA
AKO
Humanize

Job description

About the role

We are looking for a founding engineer to own kernel-level performance across our inference stack. You will identify bottlenecks, write and fuse GPU kernels, use agents to automate kernel optimization, and carry improvements through to production.


This is a deeply hands-on role with wide ownership. You will define projects from first principles, work across the hardware–software boundary, and pursue the performance gains that matter most, whether on conventional GPUs or emerging custom accelerators. There is no management layer between you and the work: you will set the direction and ship it.


About you


  • You work close to the metal and reason deeply about performance and system design


  • You work fluidly across the hardware-software boundary, and optimize as readily for traditional GPUs as for custom accelerators


  • You are drawn to the risk and upside of an early-stage startup


  • You embrace ambiguity and have a strong bias for action


  • You operate with a tech-lead mentality regardless of title or years of experience


  • You treat AI as a force multiplier: fluent with coding agents and modern AI/ML workflows, you fold them into how you ship, and you are willing to push the boundary of what’s possible with agents



Requirements


  • Deep expertise in GPU and hardware performance optimization


  • Hands‑on experience with low‑level GPU kernel programming using CUDA, Triton, or PTX


  • Experience optimizing inference through kernel fusion, quantization, speculative decoding, or sparsity


  • Proficiency with profiling and tracing tools, including Nsight Systems and Nsight Compute (nsys, ncu)


  • Working knowledge of modern LLM and multimodal model architectures


  • Experience optimizing kernels and communication for LLMs on modern GPU systems like B300 and GB300 NVL72



Bonus


  • Familiarity with custom accelerators and non-CUDA backends


  • Experience with GPU kernel libraries such as CUTLASS, cuBLAS, NCCL, CuTe DSL, and others


  • Familiarity with kernel-optimization agents and orchestration tools, such as KDA, AKO, Humanize, and agent frameworks for coordinating evaluation, iteration, and deployment



Compensation & Benefits


  • Highly competitive salary and equity


  • Comprehensive health coverage for you and your dependents


  • Strong 401(k) match


  • Meals and snacks on us + discretionary productivity budget



Strong preference for in-person in Palo Alto or Brooklyn.


About Inco

Inco AI (inco.ai) builds the agent-native inference platform for tomorrow’s token economics. We build the inference layer that makes advanced AI fast enough for real workflows and affordable enough to use at scale. Agents are at the center of our work: when a single task chains dozens of model and tool calls, every gain in speed, cost, and reliability compounds.


We’re the researchers and engineers behind AWQ, DFlash, and TensorRT-LLM, with decades of combined leadership in AI efficiency and prior successful exits. Our team connects frontier research with the engineering needed to bring fast, reliable inference to production at scale.


We operate on five principles:



  1. Operate at the frontier. The field moves every day, and so do we. We reinvent ourselves constantly and push the frontier forward with our research. We keep process light and decisions fast, so a good idea reaches production in days, not quarters. Legacy doesn’t slow us down.


  2. Mission over individuals. We are obsessed with our customers and humble in pursuit of the goal. We share credit, name mistakes early, and change our minds when the evidence says so. The question is always what moves the mission forward, never who was right.


  3. Amplify with agents. Code is free now; architecture and process aren’t. We hand agents everything they can own, from code to operations, and spend our own time on design, judgment, and the problems only people can solve.


  4. Protect the maker’s time. Focus is our scarcest resource. We keep meetings few and protect long, uninterrupted stretches of work. We automate overhead, cover meals, and handle logistics, so our hours go to research and product.


  5. Be a team player. We win as one team. We share context generously, step in wherever we’re needed, and hold each other to a high bar, because exceptional work comes from exceptional peers.


Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Inference Systems
Member of Technical Staff, Inference Systems

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Competitive salary
Equity
Health coverage
+2
Member of Technical Staff, Inference Research
Member of Technical Staff, Inference Research

Ashby, Inc. • Palo Alto (CA)

On-site
USD 200,000 - 350,000
Health coverage
401(k) match
Meals and snacks
+2
Member of Technical Staff, Developer Infrastructure & Agent Automation
Member of Technical Staff, Developer Infrastructure & Agent Automation

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Highly competitive salary and equity
Comprehensive health coverage for you
Strong 401(k) match
+1
Member of Technical Staff, Developer Infrastructure & Agent Automation
Member of Technical Staff, Developer Infrastructure & Agent Automation

Inco AI • Palo Alto (CA)

On-site
USD 180,000 - 320,000
Salary & equity
Health coverage
401(k) match
+1
Member of Technical Staff, Production
Member of Technical Staff, Production

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Health coverage
401(k) match
Meals and snacks
+1
Member of Technical Staff, General
Member of Technical Staff, General

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 300,000
Competitive salary & equity
Health coverage for you and dependents
Strong 401(k) match
+1
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Runware • United States

Remote
USD 250,000 - 420,000
Stock options
Remote-first
Generous PTO
+2
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Runware • San Jose (CA)

Remote
USD 230,000 - 420,000
Meaningful stock options
Remote-first with in-person retreats
Generous paid time off
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Runware • San Francisco (CA)

Remote
USD 180,000 - 280,000
Stock options
Remote-first culture
Flexible schedule
+1
Principal Engineer, Model Performance
Principal Engineer, Model Performance

Runware • Palo Alto (CA)

Remote
USD 260,000 - 380,000
Stock options
Remote-first culture
Generous PTO