Performance and Energy Benchmark Engineer

HushOne, Inc.; Kirkland (WA); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Stock options

401(k) with company match

Health insurance

Gym membership

Remote-friendly

Job summary

HushOne, Inc. is seeking an engineer to design experiments and benchmarks that reveal how AI systems perform across inference, retrieval, training and integrations. You will define representative workloads, record model version, quality, context, precision, memory and device conditions.

Within your first 90 days, you will publish a repeatable baseline and a reproducible comparison. You will document methodology so others can reproduce findings and report results even when they are not favorable.

Qualifications

• Experimental design, systems measurement, and clear technical writing in combination
• You can identify a cherry-picked workload and distinguish noise from a meaningful change
• You publish methodology alongside results, so somebody else can reproduce them
• The independence to report a result the company will not enjoy

Responsibilities

• Design a fair comparison between two devices when their fastest available model configurations have different quality
• Build representative task suites covering inference, retrieval, training and integrations
• Record model version, quality, context, precision, memory and device conditions
• Measure latency distributions, energy use, and task cost alongside throughput

Skills

Experimental design

Systems measurement

Technical writing

Identify cherry-picked workloads

Job description

You make performance claims useful to the person buying the computer, by measuring what the system accomplishes, what it costs, and how reliably it does it. This role exists partly to keep us honest: you are the person who will identify our own cherry-picked workload and say so.

The work: Build representative task suites covering inference, retrieval, training and integrations. Record model version, quality, context, precision, memory and device conditions. Measure latency distributions, wall energy and completed-task cost alongside raw throughput.

What good looks like: In your first 90 days, publish a repeatable baseline and a comparison that another engineer can reproduce on the same configuration.

Evidence we look for: Bring experimental design, systems measurement and clear technical writing. Be able to identify cherry-picked workloads and distinguish measurement noise from a meaningful change.

Required:

• Experimental design, systems measurement, and clear technical writing in combination
• You can identify a cherry-picked workload and distinguish noise from a meaningful change
• You publish methodology alongside results, so somebody else can reproduce them
• The independence to report a result the company will not enjoy

Nice to have:

• Energy measurement as well as performance
• You have built a benchmark suite others adopted
• Statistics depth

The exercise: Design a fair comparison between two devices when their fastest available model configurations have different quality.

How we work: We work together in the office, five days a week, and you can be based at any of our garages: Kirkland Garage (Kirkland, WA); UAE Garage (Dubai, Dubai). We hire across the United States, India and the UAE. We are remote-friendly around family: if you need to work from home some days to look after the people you love, we arrange that with you one person at a time, and we encourage people to use it rather than tough it out.

Pay: We publish what we pay. Indicative ranges by market and level are on our compensation page, and they are realistic going market rates rather than headline numbers. Wherever we hire we pay at least the local market rate, and for full-time roles our floor is a living wage, never the statutory minimum. Compensation is reviewed every year and on promotion.

Equity: Every full-time teammate gets stock options. Four-year vesting with a one-year cliff, sized to role, level and impact, and confirmed in writing at offer. High performers earn refresh grants.

Bonus and commission: An annual performance bonus tied to clear company and personal goals, indicatively 10 to 20 percent of base for non-sales roles. Customer-facing roles carry on-target earnings, typically a 50/50 split of base and variable, with uncapped commission and accelerators above quota.

Health and peace of mind: Medical, dental and vision for you and your family, plus life and disability cover. We have chosen the highest plan tier available to us rather than the cheapest one that clears the bar, because the point of this is that you never have to think about it. The specific plan numbers are confirmed in your offer letter.

401(k) with company matching: A 401(k) with a company match, so the years you spend here compound into something that is yours whatever happens next. The match formula is confirmed in your offer letter.

AI tokens: A budget of AI tokens of your own, because a company that says you should own your AI cannot be the company that rations it. Use them on the work and on whatever you are curious about.

Gym, and the everyday things: A gym membership, and a corporate benefits programme with its own app, where you redeem real discounts with a long list of retailers on the ordinary purchases of a life.

Family: We are remote-friendly around your family, arranged one person at a time, and we would rather you took it than toughed it out.

Referrals: Refer someone we hire full-time who stays a year and you get $1,000 plus $10,000 in referral stock-based equity, on top of your own package.