AI Evaluation Architect for Linux Task Challenges

Workada; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Workada is looking for a meticulous contributor who can transform real-world problems into self-contained Tasks for AI agents in a Linux terminal. You will draft briefs, prepare the execution environment with tools and files, and build reference solutions with automated checks.

A strong candidate holds a PhD or 5+ years of experience in a relevant field, is proficient in Python or Bash, and can clearly document workflows for reproducibility.

Qualifications

• PhD in a relevant field or 5+ years of professional experience.
• Comfort working in a Linux terminal and scripting (Python or Bash).
• Experience with Docker and containerized workflows.
• Attention to detail and ability to explain workflows clearly.

Responsibilities

• Translate complex problems into self-contained Tasks with briefs and environment setup.
• Develop reference solutions and automated verification checks to validate outcomes.

Skills

Linux terminal

Python or Bash scripting

Docker

Adversarial problem solving

Technical communication

Education

PhD in a relevant field

Tools

Docker

Job description

Workada is looking for a meticulous contributor who can transform real-world problems into self-contained Tasks for AI agents in a Linux terminal. You will draft briefs, prepare the execution environment with tools and files, and build reference solutions with automated checks.

A strong candidate holds a PhD or 5+ years of experience in a relevant field, is proficient in Python or Bash, and can clearly document workflows for reproducibility.