Member of Technical Staff, General

Ashby, Inc.

Palo Alto (CA)

On-site

USD 180,000 - 300,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive salary & equity
Health coverage for you and dependents
Strong 401(k) match
Meals and discretionary productivity预算

Job summary

Ashby, Inc. is seeking founding members to tackle the hardest problems in AI inference in Palo Alto.

You will work closely with researchers and engineers to identify where you can contribute, whether that’s developing new research ideas, building core systems, or bringing advances in inference into production. You should have depth in AI inference areas, production proficiency in Python and at least one systems language, and a track record of shipping work through publications, open-source, or

Qualifications

  • Exceptional depth in at least one area of AI inference: model research and post-training, quantization or speculative decoding, GPU kernels, serving systems and runtimes, or large-scale distributed infrastructure.

Responsibilities

  • Identify where you can contribute to the hardest AI inference problems.
  • Collaborate with researchers and engineers to ship end-to-end solutions.
  • Develop new research ideas, build core systems, or productionize advances in inference.

Skills

Python
Systems programming
LLM architectures
Publications/open-source

Tools

CUDA

Job description

About the role

This is our open application for founding members who want to work on the hardest problems in AI inference.

You’ll work closely with our researchers and engineers to identify where you can make the biggest contribution, whether that’s developing new research ideas, building core systems, or bringing advances in inference into production.

About you
  • You have a track record of taking ambiguous technical problems from zero to shipped results, in research, systems, or production

  • You go where the leverage is, moving between models, systems, kernels, and infrastructure rather than staying in one layer

  • You would rather own an outcome end to end than a single component, and you pick up new domains quickly

  • You’re drawn to the risk and upside of an early-stage startup

  • You embrace ambiguity and have a strong bias for action

  • You operate with a tech-lead mentality regardless of title or years of experience

  • You treat AI as a force multiplier: fluent with coding agents and modern AI/ML workflows, you fold them into how you ship, and you are willing to push the boundary of what’s possible with agents

Requirements
  • Exceptional depth in at least one area of AI inference: model research and post-training, quantization or speculative decoding, GPU kernels, serving systems and runtimes, or large-scale distributed infrastructure

  • Working knowledge of modern LLM and multimodal architectures and the performance tradeoffs behind them

  • A track record of shipping technical work others depend on, through publications in relevant venues (NeurIPS, ICLR, ICML, MLSys, ...), open-source contributions, or production systems

  • Production proficiency in Python and at least one systems language: Rust, C++, or Go

Bonus
  • Hands-on experience with open-source inference and serving stacks such as PyTorch, vLLM, SGLang, Dynamo, SMG, and TensorRT-LLM

  • Hands-on experience authoring GPU kernels with CUDA, Triton, or PTX

  • Experience with quantization (NVFP4, FP8, PTQ, QAT, QAD) or speculative decoding (DFlash, EAGLE-3)

  • Familiarity with system-wide profiling, tracing, and debugging using tools such as Nsight Systems (nsys)

  • Experience with on-device inference or accelerators beyond NVIDIA and AMD

  • A track record of operating inference workloads across 1,000+ GPUs

  • Contributions to open-source ML or systems infrastructure

Compensation & Benefits
  • Highly competitive salary and equity

  • Comprehensive health coverage for you and your dependents

  • Strong 401(k) match

  • Meals and snacks on us + discretionary productivity budget

Strong preference for in-person in Palo Alto or Brooklyn.

About Inco

Inco AI (inco.ai) builds the agent-native inference platform for tomorrow's token economics, making advanced AI fast enough for real workflows and affordable enough to use at scale. We're the researchers and engineers behind AWQ, DFlash, and TensorRT-LLM, bringing frontier research into production.

Our platform ranked #1 in output speed on Artificial Analysis for every model we launched with, and our DFlash models have surpassed 10 million downloads on Hugging Face. Backed by B Capital, E14 Fund, and Tectonic Ventures, we serve customers across serverless, dedicated, and local AI deployments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Inference Research
Member of Technical Staff, Inference Research

Ashby, Inc. • Palo Alto (CA)

On-site
USD 200,000 - 350,000
Health coverage
401(k) match
Meals and snacks
+2
Member of Technical Staff, Inference Systems
Member of Technical Staff, Inference Systems

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Competitive salary
Equity
Health coverage
+2
Member of Technical Staff, Production
Member of Technical Staff, Production

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Health coverage
401(k) match
Meals and snacks
+1
Member of Technical Staff, Developer Infrastructure & Agent Automation
Member of Technical Staff, Developer Infrastructure & Agent Automation

Inco AI • Palo Alto (CA)

On-site
USD 180,000 - 320,000
Salary & equity
Health coverage
401(k) match
+1
Member of Technical Staff, Developer Infrastructure & Agent Automation
Member of Technical Staff, Developer Infrastructure & Agent Automation

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Highly competitive salary and equity
Comprehensive health coverage for you
Strong 401(k) match
+1
Member of Technical Staff, Kernel Performance & Automation
Member of Technical Staff, Kernel Performance & Automation

Ashby, Inc. • Palo Alto (CA)

On-site
USD 180,000 - 280,000
Highly competitive salary and equity
Comprehensive health coverage for you/
Inference Engineer - Member of Technical Staff
Inference Engineer - Member of Technical Staff

Designworks Talent • Bellevue (WA)

Hybrid
USD 150,000 - 230,000
Medical, dental, and vision insurance
401(k) with company match
Paid holidays
Inference Engineer
Inference Engineer

adaption • San Francisco (CA)

On-site
USD 150,000 - 230,000
Flexible work: In-person Bay Area coll
Adaption Passport: travel stipend
Lunch Stipend: weekly meal allowance
+1
Inference Engineer
Inference Engineer

adaption • United States

Hybrid
USD 180,000 - 280,000
Flexible work
Travel stipend
Lunch stipend
+1
Senior Software Engineer - Model Performance
Senior Software Engineer - Model Performance

inference.net • San Francisco (CA)

Hybrid
USD 220,000 - 320,000
Equity in a high-growth startup
Comprehensive benefits