Inference Engineer

Designworks Talent; Bellevue (WA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Hybrid work model

Office Bellevue

Competitive compensation

Job summary

Designworks Talent is seeking an Inference Engineer to build and operate production-grade model-serving and inference systems in a hybrid Bellevue, WA setting. You’ll work across distributed systems, GPU optimization, and production AI infrastructure to deliver high-throughput, low-latency inference.

Join a fast-moving team shaping next-gen AI platforms with scalable tooling, monitoring, and reliability practices, collaborating with AI training and platform teams.

Qualifications

• Experience building and operating production ML inference or model-serving systems at scale.
• Understanding of latency, throughput, memory utilization, and cost efficiency in serving large AI models.
• Experience designing reliable distributed systems or production infrastructure.
• Familiarity with GPU-backed AI workloads and scaling inference systems.

Responsibilities

• Build and operate production-grade model-serving and inference systems for high-throughput AI workloads.
• Optimize inference infrastructure for latency, throughput, and cost efficiency across workloads.
• Design systems to maximize GPU utilization with predictable performance and reliability.
• Improve scalability and maturity of inference platforms as demand grows.
• Collaborate with AI training and platform teams for smooth transitions from development to production.
• Develop monitoring and alerting to maintain reliable inference services.
• Investigate performance, reliability, and capacity challenges in inference workloads.

Skills

Production ML inference

Distributed systems

GPU workloads understanding

Problem ownership

Fast-moving environment

Tools

vLLM

TensorRT-LLM

Triton Inference Server

Kubernetes

Cloud infrastructure

Job description

Inference Engineer

Location: Hybrid | Bellevue, WA AreaTitles: Senior and Staff (multiple roles available)

Build the Inference Platform Powering Next-Generation AI Applications

About the Opportunity

A well-funded, rapidly growing AI infrastructure company is building a next-generation cloud platform designed to power the full lifecycle of artificial intelligence. The organization is developing a comprehensive AI infrastructure, platform, and services portfolio that supports the full spectrum of AI workloads—including large‑scale compute, model training, fine‑tuning, inference, and emerging agentic AI applications.

Backed by significant long-term investment, the company combines the speed, ownership, and innovation of a startup with the stability and resources of an established parent organization. Engineering teams are intentionally lean, highly collaborative, and AI‑native, leveraging modern tooling and automation to build infrastructure capable of supporting the industry's most demanding AI workloads.

We're seeking Inference Engineers to build and operate the model‑serving systems behind a next‑generation AI inference platform. This team focuses on delivering high‑throughput, low‑latency, reliable inference experiences that enable customers to consume advanced AI capabilities through production‑scale APIs.

The Opportunity

This is a foundational engineering role focused on building the systems that bring AI models from research environments into reliable production services. You'll work on the infrastructure layer responsible for serving large models efficiently, optimizing performance, and ensuring reliability as usage scales.

You'll collaborate closely with GPU performance, AI training infrastructure, platform engineering, and operations teams to solve complex challenges around model serving, latency optimization, resource efficiency, and production reliability.

This opportunity is ideal for engineers who enjoy working at the intersection of distributed systems, machine learning infrastructure, GPU computing, and large‑scale production systems.

What You'll Do

• Build and operate production‑grade model‑serving and inference systems supporting high‑throughput, low‑latency AI workloads.

• Optimize inference infrastructure for token throughput, latency, scalability, and cost efficiency across different model architectures and workloads.

• Design systems that maximize GPU utilization while maintaining predictable performance and reliability.

• Improve the scalability and operational maturity of inference platforms as customer demand grows.

• Partner with AI training, GPU performance, orchestration, and infrastructure teams to ensure smooth transitions from model development to production serving.

• Develop monitoring, alerting, and operational practices to maintain reliable inference services.

• Investigate and resolve performance, reliability, and capacity challenges across inference workloads.

• Contribute to architecture decisions and engineering standards as the platform evolves.

What We're Looking For

• Experience building and operating production machine learning inference or model‑serving systems at scale.

• Strong understanding of the performance trade‑offs involved in serving large AI models, including latency, throughput, memory utilization, and cost efficiency.

• Experience designing reliable distributed systems or production infrastructure.

• Understanding of GPU‑backed AI workloads and the challenges of scaling inference systems.

• Strong engineering fundamentals and the ability to independently own complex technical problems.

• Comfortable working in a fast‑moving environment where systems and processes are being built from the ground up.

Preferred Qualifications

• Experience with modern inference‑serving frameworks such as vLLM, SGLang, TensorRT‑LLM, Triton Inference Server, or similar technologies.

• Experience optimizing LLM inference workloads or large‑scale AI serving platforms.

• Background operating API‑based AI products or high‑volume production services.

• Experience with GPU scheduling, distributed systems, Kubernetes, or cloud infrastructure platforms.

• Familiarity with model optimization techniques such as quantization, batching, caching, or performance tuning.

• Experience working at a hyperscaler, AI lab, GPU cloud provider, or large‑scale ML infrastructure organization.

Compensation

• Competitive base pay for Bellevue market

• Certain roles are eligible for additional rewards, including merit increases, annual bonus, and long‑term incentives. These awards are allocated based on individual performance

• U.S. based employees have access to medical, dental, and vision insurance, a 401(k) plan and company match, employees also receive per calendar year, paid holidays.

Location

• Hybrid role based in the Bellevue, WA area.

• Approximately three days per week in the office.

• Candidates elsewhere in the U.S. who are open to relocation are encouraged to apply.

• U.S. work authorization is required. Visa sponsorship is not currently available.

Why Join?

• Build the inference platform powering the next generation of AI applications.

• Work directly on large‑scale model serving, GPU optimization, and production AI systems.

• Solve complex challenges around latency, throughput, reliability, and cost efficiency.

• Join early enough to influence architecture, tooling, and engineering practices.

• Collaborate with a highly experienced team building critical AI infrastructure from the ground up.

• Enjoy the ownership and technical impact of a startup environment backed by significant long‑term investment.