Software Engineering Expert →

IsoData; United States; Remote; USD 165,000 - 331,000; Full time

Job summary

IsoData is seeking engineers who can craft tasks and tests for AI models. You will write and review tasks across the stack, build tests and reference solutions, and grade model outputs with clear rubrics.

The role emphasizes reading unfamiliar code, debugging, and creating robust evaluation materials for diverse codebases. The position is remote within the United States and pays hourly between $120 and $240, with no guaranteed volume or hours.

Qualifications

• University degree in computer science or related field; internships not required.
• One substantial coding project you built with depth: what it does, how it works and what you would change.
• You can read unfamiliar code in languages like Python, TypeScript, Java or C++ and explain why something fails.
• You test your own work: reproduce bugs, write tests and check edge cases before calling something done.

Responsibilities

• Write bug-fix and feature tasks in real open-source codebases with hidden tests that decide pass/fail.
• Review model-written pull requests line by line for correctness, security and edge cases, and explain each issue so another engineer can check it.
• Build terminal tasks, such as a broken Docker build or failing CI step, with a script that verifies the fix.
• Write algorithm problems with test cases that catch slow or subtly wrong solutions.
• Compare two model answers to the same coding question and say which is better, and why, in a few precise sentences.
• Write reference solutions and grading rubrics that two reviewers would apply the same way.

Skills

Python

TypeScript

Java

C++

Education

Bachelor's degree in Computer Science or related field

Tools

Docker

CI/CD

Job description

Remote, United States. Project-based.

For engineers who can write a task a strong model gets wrong, and prove the right answer with tests. Write and review coding tasks, tests and reference solutions across the stack.

Pay: $120 to $240 an hour, paid per accepted task. There is no guaranteed project, task volume, hours or pay.

You must live in the US, be at least 18 and be authorized to work in the United States. We accept applications on an ongoing basis.

What you would do

• Write bug-fix and feature tasks in real open-source codebases, such as a race condition in a background worker, with hidden tests that decide pass or fail.
• Review model-written pull requests line by line for correctness, security and edge cases, and explain each issue so another engineer can check it.
• Build terminal tasks, such as a broken Docker build or a failing CI step, with a script that verifies the fix.
• Write algorithm problems with test cases that catch slow or subtly wrong solutions.
• Compare two model answers to the same coding question and say which is better, and why, in a few precise sentences.
• Write reference solutions and grading rubrics that two reviewers would apply the same way.

The minimum

• You study at or graduated from a college or university. Internships are not required.
• One substantial coding project you built, on your own or with AI tools, that you can explain in depth: what it does, how it works and what you would change.
• You can read unfamiliar code in a common language, such as Python, TypeScript, Java or C++, and explain exactly why something fails.
• You test your own work: you reproduce bugs, write tests and check edge cases before calling something done.

Ideal

• A degree in computer science or a related field; a master’s or PhD is even better.
• Professional engineering work, especially at an AI lab or AI company.
• Code other people rely on: a shipped product, an open-source project or a library you maintain.
• Depth in more than one area, such as backend and security, or systems and performance.
• Experience reviewing other people’s code, as a maintainer, team lead or teaching assistant.

This position covers

Backend and systems, Frontend and web, DevOps and terminal, Security (defensive), Mobile, Code review.

IsoData provides equal opportunity to all applicants. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, citizenship status, age, disability, genetic information, veteran status or any other protected trait. Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

IsoData recruits Experts for its own projects.