AI Interaction Evaluator — Staff Engineer (Contract)

G2i Inc.; Oregon; Híbrido; USD 83 000 - 165 000; Tempo parcial

Resumo da oferta

G2i Inc. seeks a Staff/Principal-level engineer to evaluate AI coding agents like OpenAI Codex, Claude Code and Cursor. You won’t write production code; you’ll judge whether the model thinks like a strong engineer and provide decisive feedback.

Hours are ~20 hours per week, short-term engagements from 2 weeks to 6 months, remote in the United States. You will assess how the model handles real-world coding scenarios and communicate standards for excellent engineering interactions.

Qualificações

• Staff / Principal-level engineer or equivalent experience.
• Strong background in Go, Python, Rust or TS/JavaScript.
• Hands-on experience with OpenAI Codex, Claude Code and Cursor.
• Deep familiarity with modern AI-assisted dev workflows.

Responsabilidades

• Evaluate AI-generated coding interactions end-to-end.
• Judge usefulness, correctness, and engineering judgment.
• Assess explanations and reasoning, not just code.
• Distinguish between quality levels of responses (2 vs 4).
• Provide clear, opinionated feedback on what worked and what didn’t.
• Define what great looks like when using AI tools.

Conhecimentos

Go

Python

Rust

TypeScript/JavaScript

Ferramentas

OpenAI Codex

Claude Code

Cursor

Descrição da oferta de emprego

G2i Inc. seeks a Staff/Principal-level engineer to evaluate AI coding agents like OpenAI Codex, Claude Code and Cursor. You won’t write production code; you’ll judge whether the model thinks like a strong engineer and provide decisive feedback.

Hours are ~20 hours per week, short-term engagements from 2 weeks to 6 months, remote in the United States. You will assess how the model handles real-world coding scenarios and communicate standards for excellent engineering interactions.