Member of Technical Staff - Inference Systems

liquid-ai

United States

Hybrid

USD 140,000 - 230,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Health premiums
401(k) matching
Unlimited PTO

Job summary

Liquid AI in Boston, MA is seeking a Member Of Technical Staff, Infrastructure to advance the inference stack and benchmarking capabilities. You will design and run benchmark suites, port models across runtimes, and validate outputs across partner environments in a hybrid, full-time role.

Collaborating with Research & Engineering, you will ensure correctness, performance, and reproducibility, shaping how we evaluate models and deployments across devices and data centers.

Qualifications

  • Hands-on with at least one inference framework (llama.cpp, ONNX Runtime, or MLX) and internal modifications.
  • Experience designing benchmarking pipelines with validation and reproducibility.
  • Strong C++ and Python in performance-sensitive contexts.
  • Solid understanding of quantization and memory layout in inference.

Responsibilities

  • Design and build benchmark suites for inference performance and model quality.
  • Run external partner verifications against benchmarks and report findings.
  • Port models like LFM2 onto runtimes and verify end-to-end correctness.
  • Maintain the inference engine layer built on llama.cpp, ONNX, and MLX.
  • Make benchmark results explainable and reproducible for teams and partners.

Skills

Inference frameworks
Benchmarking pipelines
C++/Python perf
Inference fundamentals

Tools

llama.cpp
ONNX Runtime
MLX

Job description

Liquid AI Job Description

Role: Member Of Technical Staff, Infrastructure
Department: Research & Engineering
Location: Boston
Location Type: Hybrid
Employment Type: Full-time

About Liquid AI

Spun out of MIT CSAIL, we build general-purpose AI systems that run efficiently across deployment targets, from data center accelerators to on-device hardware, ensuring low latency, minimal memory usage, privacy, and reliability. We partner with enterprises across consumer electronics, automotive, life sciences, and financial services. We are scaling rapidly and need exceptional people to help us get there.

The Opportunity

Our inference stack is central to everything we ship. You'll be a core part of the team responsible for the engine layer that runs our models in production and in partner environments, and for the benchmarking infrastructure we use to evaluate our own work and verify what partners bring to us. Day to day, that means working closely with research and product, but also directly with external engineering teams.

What We're Looking For
  • Can pick up unfamiliar tools quickly and knows how to assess whether they're worth using.
  • Designs AI benchmarks and holds methodology to a high standard.
  • Cares about inference details, understands the tradeoffs, and checks what changed across the board before calling something done.
  • Doesn't consider a model port finished until you can prove the outputs are correct.
The Work
  • Design and build benchmark suites that cover inference performance, model quality, and knowledge evaluation across different hardware targets.
  • Run external partner verifications: evaluate their solutions against our benchmarks, identify gaps, and clearly deliver findings.
  • Port models like LFM2 onto different runtimes and frameworks, and verify correctness end-to-end.
  • Maintain and extend the inference engine layer built on llama.cpp, ONNX, and MLX as new model architectures emerge from research.
  • Make benchmark results explainable and verifiable, so internal teams and partners can trust and reproduce them independently.
Desired Experience
Must-have:
  • Hands-on experience with at least one inference framework like llama.cpp, ONNX Runtime, or MLX, going beyond basic usage into internals and modification.
  • Experience designing and building benchmarking pipelines, including methodology, validation, and reproducibility.
  • Strong C++ and Python in performance-sensitive contexts.
  • Solid understanding of inference fundamentals: quantization, decoding strategies, memory layout, and how they interact.
Nice-to-have:
  • Experience porting models across runtimes and verifying numerical correctness.
  • Prior work with external partners or clients in a technical validation or evaluation capacity.
  • Familiarity with edge inference targets and the constraints that come with them.
What Success Looks Like (Year One)

You've ported LFM2 onto multiple runtimes and platforms, you know the model inside out, and new ports take you a fraction of the time they did at the start.

You've run multiple partner verifications end-to-end and built enough context to spot weak evaluations quickly and push back with evidence.

The benchmark suite covers inference performance and model quality across the platforms we care about, and both internal teams and partners are using it as a reference.

What We Offer
  • Compensation: Competitive base salary with equity in a unicorn-stage company
  • Health: We pay 100% of medical, dental, and vision premiums for employees and dependents
  • Financial: 401(k) matching up to 4% of base pay
  • Time Off: Unlimited PTO plus company-wide Refill Days throughout the year
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff - Inference Systems
Member of Technical Staff - Inference Systems

Liquid AI • Boston (MA)

Hybrid
USD 180,000 - 240,000
Equity
Health insurance
401(k) matching
+2
Member of Technical Staff - GPU Inference Engineer
Member of Technical Staff - GPU Inference Engineer

Liquid AI • San Francisco (CA)

Hybrid
USD 180,000 - 240,000
Equity
Unlimited PTO
Health coverage
Member of Technical Staff - Product Engineer (Console/API)
Member of Technical Staff - Product Engineer (Console/API)

Liquid AI • San Francisco (CA)

On-site
USD 140,000 - 210,000
Direct product impact
Equity
Unlimited PTO
+1
Member of Technical Staff - Product Engineer
Member of Technical Staff - Product Engineer

Liquid AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Direct product impact
Equity
Unlimited PTO
+2
Member of Technical Staff (Inference)
Member of Technical Staff (Inference)

FDE Times • San Francisco (CA)

On-site
USD 120,000 - 180,000
Equity
Competitive compensation
Developer Relations
Developer Relations

Liquid AI • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Full health coverage
401(k) matching
+2
Member of Technical Staff - Post Training, Applied (Text)
Member of Technical Staff - Post Training, Applied (Text)

Liquid AI • San Francisco (CA)

On-site
USD 100,000 - 140,000
Competitive base salary with equity
100% paid health, dental, and vision premiums
401(k) matching up to 4%
+1
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

Kindredventures • Palo Alto (CA)

Hybrid
USD 190,000 - 250,000
Comprehensive health insurance
Dental insurance
Vision insurance
+1
Strategic Partnerships, Silicon Ecosystem
Strategic Partnerships, Silicon Ecosystem

liquid-ai • United States

On-site
USD 120,000 - 180,000
Equity
Unlimited PTO
Health coverage
+2
Member of Technical Staff – ML Research Engineer, Pre-Training Data
Member of Technical Staff – ML Research Engineer, Pre-Training Data

AItoolnavio • San Francisco (CA)

On-site
USD 150,000 - 220,000
Unlimited PTO
Equity
Health coverage
+1