Senior Python AI Evaluation Engineer — Remote

Jobgether; Ireland; Remote; EUR 123,000 - 247,000; Full time

Benefits offered by this job

Hourly rate $100–$200

Fully remote contract

Flexible 10–20 hours/week

Worldwide availability

Project-based engagements

Job summary

Jobgether seeks a Python Senior Software Engineer for AI training evaluation, based in Ireland. You will assess AI-generated coding interactions, examine explanations and usefulness, and provide detailed feedback to shape benchmarks for high-quality AI-assisted development.

The role is fully remote, project-based, with a flexible workload of 10–20 hours per week and compensation ranging from $100 to $200 per hour.

Qualifications

• Senior, Staff or Principal level software engineering experience.
• Strong Python background; experience in TypeScript/JavaScript is a plus.
• Hands-on with OpenAI Codex, Claude Code or Cursor.
• Excellent written and spoken English communication.

Responsibilities

• Evaluate AI-generated coding interactions from start to finish and provide expert feedback.
• Assess usefulness, technical soundness, and alignment with experienced software engineering practices.
• Evaluate explanations, reasoning and recommendations, not just code correctness.
• Record short video explanations to communicate findings and context.

Skills

Python

TypeScript/JS

AI coding tools

Job description

Jobgether seeks a Python Senior Software Engineer for AI training evaluation, based in Ireland. You will assess AI-generated coding interactions, examine explanations and usefulness, and provide detailed feedback to shape benchmarks for high-quality AI-assisted development.

The role is fully remote, project-based, with a flexible workload of 10–20 hours per week and compensation ranging from $100 to $200 per hour.