Senior Software Engineer: AI Coding Tasks (Remote, Contract)

Askable; Brisbane; Remote; AUD 93,677,000 - 104,698,000; Full time

Job summary

Askable is seeking a Senior Software Engineer to craft AI coding tasks on a remote basis. You will transform known repository changes into tasks, write briefs, correct solutions, and robust grading checks.

Tasks are used to train AI models and improve evaluation systems. Requirements include 2+ years of software engineering, proficiency in one of Python/TypeScript/Go/Rust/Java/C++, and strong testing practices.

Qualifications

• 2+ years of professional software engineering
• Strong in at least one language (Python/TypeScript/Go/Rust/Java/C++)
• Docker, Linux, Git and automated testing
• Regular use of an AI coding tool
• Experience writing tests, rubrics or evaluation criteria for AI models
• Ability to explain a change clearly and concisely
• At least 10 hours a week starting now

Responsibilities

• Propose a change from a repository you know and submit a short proposal
• Build the task: set up repo as before the change, write the brief, solution, and grading checks
• Stress-test: ensure checks catch lazy/incorrect/shortcut solutions
• Model testing: run tasks against leading AI models to reveal weaknesses
• Review: undergo multiple rounds of review and revision
• Start new task after acceptance

Skills

2+ years exp

Python

TypeScript

Go

Rust

Java

C++

AI coding tool

Automated testing

Testing rubrics

Tools

Docker

Linux

Git

Job description

Askable is seeking a Senior Software Engineer to craft AI coding tasks on a remote basis. You will transform known repository changes into tasks, write briefs, correct solutions, and robust grading checks.

Tasks are used to train AI models and improve evaluation systems. Requirements include 2+ years of software engineering, proficiency in one of Python/TypeScript/Go/Rust/Java/C++, and strong testing practices.