Senior Software Engineer - AI Tool Evaluator (Remote)

Jobgether; Ireland; Remote; EUR 123,000 - 247,000; Full time

Benefits offered by this job

Competitive hourly compensation

Fully remote engagement

Flexible workload 10-20 hours per week

Ongoing project-oriented engagement

Opportunity to work with cutting-edge

Job summary

Jobgether, listing on behalf of a partner company, seeks a Senior Software Engineer to evaluate AI coding agents such as OpenAI Codex, Claude Code, and Cursor. This remote, project-based role focuses on quality assessments and structured feedback for developers using AI tools.

You will review responses, explanations, and recommendations, provide detailed written notes, and help set standards for useful, trustworthy AI-assisted software engineering.

Qualifications

• Senior, Staff, or Principal-level software engineer, or equivalent professional experience.
• Strong background in TypeScript, JavaScript, or Python.
• Hands-on experience using at least one of the following tools: OpenAI Codex, Claude Code, or Cursor.
• Deep familiarity with modern AI-assisted software development workflows.
• Ability to evaluate code and technical responses without necessarily executing the code or reviewing every line.
• Strong written and spoken English proficiency (B2 level or above).
• Confidence in providing direct, thoughtful, and opinionated feedback.
• High standards for software engineering quality and understanding of useful technical guidance.
• Ability to assess engineering judgment, communication quality, and developer experience beyond basic technical correctness.

Responsibilities

• Evaluate AI-generated coding interactions from start to finish, including responses and explanations.
• Assess usefulness, correctness, and alignment with strong software engineering judgment.
• Review explanations and reasoning, not just code syntax.
• Differentiate levels of response quality using consistent criteria.
• Provide detailed written feedback on what worked, what didn’t, and what was misleading.
• Evaluate whether AI tools guide developers effectively and build trust.
• Help define quality standards for AI coding tools.
• Record short video explanations to communicate findings.

Skills

TypeScript

JavaScript

Python

Tools

OpenAI Codex

Claude Code

Cursor

Job description

Jobgether, listing on behalf of a partner company, seeks a Senior Software Engineer to evaluate AI coding agents such as OpenAI Codex, Claude Code, and Cursor. This remote, project-based role focuses on quality assessments and structured feedback for developers using AI tools.

You will review responses, explanations, and recommendations, provide detailed written notes, and help set standards for useful, trustworthy AI-assisted software engineering.