Remote AI Evaluation Engineer - Contractor

Cross Border Talents; United States; On-site; USD 83,000 - 165,000; Full time

Benefits offered by this job

Fully remote

Flexible schedule

Job summary

Cross Border Talents is seeking an experienced AI Engineer to join our remote contractor team. You will design and evaluate AI systems, creating challenging tasks that test solver abilities across modern software stacks.

Strong software engineering skills trump prior AI experience. You will build reproducible environments, verification workflows, and reference solutions while working flexibly from anywhere with a fully remote setup.

Qualifications

• Proficiency in one or more of listed languages (C++, Python, Java, Go, TypeScript, or Rust).
• Strong fundamentals in algorithms and data structures.
• Experience debugging complex software issues.
• Experience with performance optimization and scalable code.

Responsibilities

• Create realistic AI evaluation tasks for software engineers.
• Develop reinforcement learning environments using Model Context Protocol (MCP) tools.
• Design tasks involving bug fixes, feature implementation, refactoring, and performance optimization.
• Build deterministic verification and testing processes to evaluate solutions.
• Develop reference or golden solutions for benchmarking.
• Ensure environments are reproducible, reliable, and representative of real-world engineering workflows.
• Analyze complex codebases to identify meaningful engineering challenges.
• Document tasks, solutions, and evaluation criteria clearly.

Skills

C++

Python

Java

Go

TypeScript

Rust

Tools

MCP tools

Job description

Cross Border Talents is seeking an experienced AI Engineer to join our remote contractor team. You will design and evaluate AI systems, creating challenging tasks that test solver abilities across modern software stacks.

Strong software engineering skills trump prior AI experience. You will build reproducible environments, verification workflows, and reference solutions while working flexibly from anywhere with a fully remote setup.