Senior Systems & Hardware Engineer — AI Benchmarking

Joinkeywork; United States; Remote; USD 262,000 - 358,000; Full time

Job summary

Joinkeywork is seeking experienced systems or hardware engineers to create AI benchmark tasks. You’ll identify challenging problems from your field and shape them into clearly defined Linux-terminal exercises for AI agents to solve from scratch.

You'll design tasks that stress models, tested on three leading models with three attempts each, and must show difficulty. Onboarding includes courses and a graded assessment; compensation is per task up to $1,350.

Qualifications

• 9+ years of relevant professional experience in systems engineering or hardware engineering.
• Master's degree or higher; bachelor's degree + 10+ years with publication may be considered.
• Degrees completed and not currently enrolled in a degree program.
• At least one academic or professional publication.
• Practical comfort working in a Linux terminal.
• Residence in listed eligible countries including the United States.

Responsibilities

• Identify difficult, meaningful problems in your area of expertise.
• Translate those problems into tasks solvable in a Linux terminal.
• Design challenges that expose AI models' limitations and test across models with multiple attempts.

Skills

Linux terminal

Systems engineering

Hardware engineering

Education

Master's degree or higher

Bachelor's degree + 10+ years with publication

Job description

Joinkeywork is seeking experienced systems or hardware engineers to create AI benchmark tasks. You’ll identify challenging problems from your field and shape them into clearly defined Linux-terminal exercises for AI agents to solve from scratch.

You'll design tasks that stress models, tested on three leading models with three attempts each, and must show difficulty. Onboarding includes courses and a graded assessment; compensation is per task up to $1,350.