Amsterdam Device Lab Benchmark Engineer

Desert Ant Labs; Amsterdam; On-site; EUR 90,000 - 120,000; Full time

Job summary

Desert Ant Labs in Amsterdam is seeking a role to build the device lab and benchmarking system used to publish latency, memory, and accuracy figures for our models. You will run benchmarks on the latest hardware and prepare reports that highlight bottlenecks and proposed fixes.

You will translate results into charts, model card sections, and blog posts, and prepare demo apps with go-to-market and marketing teams.

Qualifications

• Know what skews a mobile benchmark: thermal throttling, background load, warm vs cold runs, charging state.
• Have measured models on Core ML, LiteRT, or ONNX Runtime and can explain why results vary between runs.

Responsibilities

• Keep an inventory of all team hardware: laptops, phones, tablets, and training machines.
• Send bottleneck reports to the model and runtime engineers, with a profile and a proposed fix.
• Build demo apps and examples with go-to-market and marketing.
• Turn results into charts, model card sections, and blog posts.
• Run our models on new hardware, from the latest phones to robots.

Skills

Benchmarking knowledge

Hardware lab management

Clean code

Code review

Tools

Core ML

LiteRT

ONNX Runtime

Claude Code

Job description

Desert Ant Labs in Amsterdam is seeking a role to build the device lab and benchmarking system used to publish latency, memory, and accuracy figures for our models. You will run benchmarks on the latest hardware and prepare reports that highlight bottlenecks and proposed fixes.

You will translate results into charts, model card sections, and blog posts, and prepare demo apps with go-to-market and marketing teams.