Senior AI Coding QA Engineer - Taste & Evaluation (Remote)

Openkrill; United States; Remote; USD 138,000 - 276,000; Part time

Job summary

Openkrill seeks a senior-level software engineer to evaluate how AI coding agents think and respond in real-world scenarios. You will assess usefulness, quality of explanations, and engineering judgment without writing production code.

The role emphasizes subjective, rigorous evaluation, clear written feedback, and video explanations. Flexible remote engagement with 10–20 hours per week and pay of $100–$200 per hour depending on experience.

Qualifications

• Senior, Staff or Principal-level engineer (or equivalent experience).
• Strong background in TypeScript/JavaScript or Python.
• Excellent written and spoken English (B2 or above).

Responsibilities

• Evaluate AI-generated coding interactions end to end.
• Provide clear, opinionated feedback on what worked and what didn’t.
• Assess explanations and reasoning, not just the code.
• Help define what great looks like when using AI coding assistants.

Skills

TypeScript/JavaScript

Python

English proficiency

Tools

OpenAI Codex

Claude Code

Cursor

Job description

Openkrill seeks a senior-level software engineer to evaluate how AI coding agents think and respond in real-world scenarios. You will assess usefulness, quality of explanations, and engineering judgment without writing production code.

The role emphasizes subjective, rigorous evaluation, clear written feedback, and video explanations. Flexible remote engagement with 10–20 hours per week and pay of $100–$200 per hour depending on experience.