Software Engineer, AI Coding Tasks

Askable

Netherlands

Remote

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Askable is seeking experienced software engineers to craft AI coding tasks from codebases you know well. Each task passes a quality review and pays US$1,000, with no cap on tasks and a commitment of at least 10 hours per week.

Work remotely from any location, building tasks that stress-test AI models and contribute to model training. You’ll select a repository change, write briefs, solutions, and grading checks, and iteratively refine tasks through reviews.

Qualifications

  • 2+ years of professional software engineering.
  • Code merged into a public open-source repository, ideally one you know well.
  • A private codebase you own may also qualify (not employer or client code).
  • Strong in at least one of Python, TypeScript, Go, Rust, Java or C++.
  • Solid with Docker, Linux, Git and automated testing.
  • Regular use of an AI coding tool.
  • Experience writing tests, rubrics or evaluation criteria, ideally for AI models.
  • You can explain a change clearly and concisely, in your own words.
  • At least 10 hours a week, starting now.
  • A secure personal or work computer (no public or shared machines).

Responsibilities

  • Build AI coding tasks from known codebases for AI model evaluation.
  • Translate repository changes into clearly defined tasks, briefs, and solution descriptions.
  • Set up the repository as it was before the change, and create grading checks.
  • Stress-test tasks against incorrect or suboptimal solutions.
  • Run task simulations against leading AI models to identify failure modes.
  • Undergo review rounds and revise tasks as needed.
  • Move on to the next task after acceptance.

Skills

Python
TypeScript
Go
Docker
Linux
Git
Automated tests
AI tooling
Test design

Tools

GitHub Actions
CI/CD

Job description

Job Overview

We're looking for experienced software engineers to build AI coding tasks from a codebase they know well. US$1,000 per task, and you can do as many tasks as you want. You turn a real change from a repository you know into a task that today's best AI coding models struggle with: hard for the models, but fair for a skilled engineer. Your tasks are used to measure and train AI coding models. Remote, any location. US$1,000 per task that passes review. Minimum of one task a week, about 10 hours a week.

How it works
  • Apply. Complete a short screener interview and upload your resume.
  • Propose. Once you're selected, pick a change from a repository you know and submit a short proposal. We approve it or suggest a better candidate.
  • Build. In our platform, set up the repository as it was before the change, then write the brief, the correct solution and the grading checks.
  • Stress-test. Try lazy, incorrect and shortcut solutions and make sure your checks catch them.
  • Model testing. Run your task against leading AI models until strong models often fail but a skilled engineer can clearly solve it.
  • Review. A reviewer checks your task and you revise it. Most tasks take more than one round.
  • Next task. Once your task is accepted, start another.
Requirements
  • 2+ years of professional software engineering
  • Code merged into a public open-source repository, ideally one you know well.
  • A private codebase you own may also qualify (not employer or client code)
  • Strong in at least one of Python, TypeScript, Go, Rust, Java or C++
  • Solid with Docker, Linux, Git and automated testing
  • Regular use of an AI coding tool
  • Experience writing tests, rubrics or evaluation criteria, ideally for AI models
  • You can explain a change clearly and concisely, in your own words
  • At least 10 hours a week, starting now
  • A secure personal or work computer (no public or shared machines)
Nice to have
  • Deep expertise in one area, such as databases, compilers, distributed systems, security or infrastructure
  • Experience building agent tasks or RL environments
Terms

US$1,000 for each task that passes our quality review, paid directly to you. Once your proposal is qualified, you sign Askable's contract and accept its terms. The work is used for AI training. The change and your solution must be your own, and you must be free to license them to us. Don't publish the work anywhere: no public pull request or public fork.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Software Engineer - AI Task Designer for Models
Remote Software Engineer - AI Task Designer for Models

Askable • Netherlands

Remote
Confidential
Software Engineering AI Trainer (Netherlands)
Software Engineering AI Trainer (Netherlands)

Anyone AI Inc. • Netherlands

Remote
EUR 55,000 - 138,000
Change Consultant - AI Trainer - Freelance - 8-20 hrs/week - Remote
Change Consultant - AI Trainer - Freelance - 8-20 hrs/week - Remote

10x Team • Netherlands

Remote
EUR 55,000 - 110,000
ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM)
ML Inference Engineer â Terminal-Bench Task Designer (vLLM / SGLang / TensorRT-LLM)

Toptal • Netherlands

Remote
EUR 83,000 - 138,000
Full-Stack Developer - AI Trainer (Netherlands)
Full-Stack Developer - AI Trainer (Netherlands)

Anyone AI Inc. • Netherlands

Remote
EUR 83,000 - 138,000
Sr. Full-Stack Software Engineer
Sr. Full-Stack Software Engineer

EVB • Netherlands

Remote
EUR 50,000 - 112,000
Flexible hours
Remote work
Competitive pay per task
Remote Backend AI Trainer - Part-Time Engineering Consultant
Remote Backend AI Trainer - Part-Time Engineering Consultant

Anyone AI Inc. • Netherlands

Remote
EUR 83,000 - 165,000
Remote AI Software Engineer Trainer - Part-Time Consultant
Remote AI Software Engineer Trainer - Part-Time Consultant

Anyone AI Inc. • Netherlands

Remote
EUR 55,000 - 138,000
AI Engineer, Developer Automation
AI Engineer, Developer Automation

Mbianchi • Amsterdam

Hybrid
EUR 175,000 - 245,000
Remote Senior Software Engineer
Remote Senior Software Engineer

Turing • Netherlands

Remote
EUR 60,000 - 80,000