Software Engineer, AI Coding Tasks

NoDesk; United States; Remote; USD 39,000 - 52,000; Full time

Job summary

NoDesk is seeking experienced software engineers to craft AI coding tasks from repositories you know well. You will propose changes, reconstruct the repo state, write clear task briefs, implement the correct solution with tests, and design robust grading checks.

Tasks are paid $1,000 each once they pass quality review, with a minimum of one task per week and roughly 10 hours weekly. Remote work is available globally.

Qualifications

• 2+ years of professional software engineering
• Code merged into a public open-source repository, ideally one you know well
• Strong in at least one of Python, TypeScript, Go, Rust, Java or C++
• Solid with Docker, Linux, Git and automated testing
• Regular use of an AI coding tool
• Experience writing tests, rubrics or evaluation criteria
• Ability to explain a change clearly and concisely
• At least 10 hours a week, starting now
• A secure personal or work computer (no public or shared machines)

Responsibilities

• Propose changes from repositories you know well
• Set up the repository state as it was before the change
• Write brief task descriptions, the correct solution and grading checks
• Stress-test with lazy, incorrect and shortcut solutions
• Run your task against AI models to ensure solvability by a skilled engineer
• Undergo reviewer checks and revise as needed
• Begin another task after acceptance

Skills

Python

TypeScript

Go

Rust

Java

C++

Tools

Docker

Linux

Git

Automated testing

Job description

We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$1,000 per task, and you can do as many tasks as you want.

You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models.

Remote, any location. US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.

How it works

• Propose. Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.
• Build. In our platform, set up the repository as it was before the change, then write the brief, the correct solution and the grading checks.
• Stress-test. Try lazy, incorrect and shortcut solutions and make sure your checks catch them.
• Model testing. Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.
• Review. A reviewer checks your task and you revise it. Most tasks take more than one round.
• Next task. Once your task is accepted, start another.

Requirements

2+ years of professional software engineeringCode merged into a public open-source repository, ideally one you know well. A private codebase you own may also qualify (not employer or client code)Strong in at least one of Python, TypeScript, Go, Rust, Java or C++Solid with Docker, Linux, Git and automated testingRegular use of an AI coding toolExperience writing tests, rubrics or evaluation criteria, ideally for AI modelsYou can explain a change clearly and concisely, in your own wordsAt least 10 hours a week, starting nowA secure personal or work computer (no public or shared machines)

Nice to have

Deep expertise in one area, such as databases, compilers, distributed systems, security or infrastructureExperience building agent tasks or RL environments

Terms

US$1,000 for each task that passes our quality review, paid directly to youOnce your proposal is qualified, you sign Askable's contract and accept its termsThe work is used for AI training. The change and your solution must be your own, and you must be free to license them to usDon't publish the work anywhere: no public pull request or public fork