Customer-Facing GPU Optimization Engineer

Zymtrace; United States; Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Equity

401(k) plan

Health insurance

Learning budget

Job summary

Zymtrace is seeking a Forward Deployed Engineer to bridge between our customers and our engineering team. You will work with AI/ML engineers, SRE leads, and decision-makers at large GPU fleets to deploy and optimize Zymtrace, with zero code changes required for customers.

In this high-impact, early-stage role you’ll shape how world-class organizations think about GPU optimization and realize maximum value from their hardware investments.

Qualifications

• 2+ years in forward deployed or equivalent customer-facing engineering role.
• Strong understanding of CUDA and GPU memory hierarchies.
• Hands-on experience with PyTorch/JAX.
• Familiarity with Linux internals and profiling tools.
• Ability to communicate complex concepts to engineers and executives.
• Self-starter in a fast-moving, early-stage environment.

Responsibilities

• Own the technical relationship with enterprise customers from PoC through production deployment and ongoing optimization
• Design and deliver technical demos, workshops, and architecture reviews tailored to each customer’s workloads
• Partner closely with founders and sales on technical discovery, scoping, and deal strategy
• Build and maintain technical content: reference architectures, deployment guides, case studies, and best practices documentation
• Represent Zymtrace at industry events and in the AI infrastructure community
• Collaborate with engineering to improve the product based on real-world feedback

Skills

Customer-facing engineering

GPU computing

PyTorch/JAX

Linux internals

Effective communication

Tools

Nsight Compute

Kubernetes

OpenTelemetry

Prometheus

Grafana

Job description

Organizations spend billions on GPU infrastructure to power AI, yet roughly 60-65% of that investment is wasted on underutilized hardware, idle cycles, and inefficient workloads. The problem isn’t the teams running them — it’s that existing tools treat GPUs as black boxes, showing surface-level metrics without revealing where the waste actually lives.

Zymtrace is a distributed AI infrastructure optimization platform that gives our customers deep, always-on visibility into general-purpose and GPU-accelerated workloads across their entire clusters. We profile from PyTorch and JAX code through CUDA kernels all the way down to individual GPU instructions and stall reasons, then correlate everything back to the CPU code that triggered it. Zero code changes. Zero guesswork.

We work with leading AI labs, Fortune 500 companies, and research firms to debug and optimize their most demanding workloads. Read the anam.ai case study .

Our founders were part of the team that pioneered, open-sourced, and contributed the eBPF continuous CPU profiler to OpenTelemetry, the same technology now adopted by Google, IBM, Datadog, Grafana, and others. We’re now applying that same low-level engineering depth to GPU-bound workloads.

We’re a team of kernel hackers and systems programmers who operate at the deepest layers of the stack: GPUs, CUDA runtimes, eBPF, compilers, and instruction-level introspection.

By joining Zymtrace, you’ll work at the bleeding edge of modern computing, helping organizations optimize AI training and inference workloads at massive scale. The problems we solve touch every layer of the stack, and the impact is measured in millions of GPU-hours reclaimed.

About the Role

As a Forward Deployed Engineer, you’ll be the technical bridge between Zymtrace and our most important customers. You’ll work directly with AI/ML engineering teams, SRE leads, and infrastructure decision-makers at companies running large-scale GPU fleets to help them understand, deploy, and extract maximum value from Zymtrace.

This is a high-impact, early-stage role where you’ll shape how some of the world’s most demanding organizations think about GPU optimization.

GPU optimization is one of the hardest and most consequential problems in modern computing. You’ll help customers squeeze every drop of performance from the hardware that powers the AI revolution.

Key Responsibilities

• Own the technical relationship with enterprise customers from proof-of-concept through production deployment and ongoing optimization
• Design and deliver technical demos, workshops, and architecture reviews tailored to each customer’s inference and training workloads
• Partner closely with founders and sales on technical discovery, scoping, and deal strategy
• Build and maintain technical content: reference architectures, deployment guides, case studies, and best practices documentation
• Represent Zymtrace at industry events, conferences, and in the broader AI infrastructure community
• Collaborate with engineering to improve the product based on real-world customer feedback and deployment patterns

What We’re Looking For

• 2+ years in a forward deployed, solutions architecture, sales engineering, or technical customer-facing engineering role within infrastructure, observability, or cloud-native tooling
• Strong understanding of GPU computing: CUDA, GPU memory hierarchies, inference and training pipelines, and common performance bottlenecks
• Hands-on experience with AI/ML frameworks such as PyTorch, JAX or similar
• Familiarity with Linux systems internals, profiling tools, and observability stacks (OpenTelemetry, Prometheus, Grafana, etc.)
• Ability to communicate complex, low-level technical concepts clearly to both engineers and executive stakeholders
• Self-starter mentality suited to a fast-moving, early-stage environment where you’ll define your own playbook

Nice to Have

• Experience with eBPF, kernel tracing, or low-level performance engineering
• Experience with Helm charts and Kubernetes
• Background in HPC, scientific computing, or quantitative research infrastructure
• Familiarity with NVIDIA tools like Nsight Compute, DCGM, or NVML
• Previous experience at an infrastructure or developer tools startup
• Existing relationships with AI/ML infrastructure teams at major enterprises or cloud providers

Why Join Zymtrace?

• Work at the frontier. GPU optimization is one of the hardest and most consequential problems in modern computing. You’ll help customers squeeze every drop of performance from hardware that powers the AI revolution.
• Shape the company. This is an early-stage team. Your fingerprints will be on the product, the go-to-market motion, and the culture.
• World-class teammates. You’ll work alongside engineers who helped build the eBPF profiler for OpenTelemetry, created disassemblers used in Firefox and WebKit, and joined from Google to hack on compilers and kernels.
• Real customer impact. Our customers include leading AI labs and Fortune 500 companies. The work you do will directly translate into faster models, lower costs, and reclaimed infrastructure budgets.
• Competitive salary and meaningful equity
• 401(k) plan
• Comprehensive health, dental, and vision insurance
• Annual learning and development budget

Application Form

Full Name

Email

Phone Number Please include your country

LinkedIn Profile ⭐ We tend to review this before your resume!

⭐ We tend to review this before your resume!

Recent Project Highlight 0 /50 words

Upload CV/Resume Choose a file or drag it here
PDF, DOC, DOCX (Max 2MB) No file selected

I can provide references for my work

Job ID: sa-01

Application Submitted Successfully!

Thank you for your application. We will assess your profile and be in touch shortly should it meet the role’s requirements.