Remote AI Evaluation Engineer: RL Tasks & Challenges

Cross Border Talents; Alabama; On-site; USD 83,000 - 165,000; Part time

Benefits offered by this job

Fully remote

Flexible schedule

Job summary

Cross Border Talents is seeking an AI Engineer for a fully remote contractor role. You will evaluate and improve next-generation AI systems by designing realistic programming tasks that test an AI model's reasoning and coding abilities.

You'll create reinforcement learning environments, build reproducible test environments, and develop reference solutions to benchmark AI agents. Strong software engineering experience is the primary qualification; prior AI experience is not required.

Qualifications

• Strong proficiency in one or more of C++, Python, Java, Go, TypeScript, or Rust.
• Solid understanding of algorithms, data structures, and software engineering fundamentals.
• Demonstrated experience debugging complex software issues.
• Strong experience developing features and refactoring existing codebases.
• Experience with performance optimization and scalability.
• Excellent written and verbal communication skills.
• Strong attention to detail and ability to produce reliable, high-quality work.

Responsibilities

• Create realistic software engineering tasks for AI model evaluation.
• Develop reinforcement learning environments using MCP tools.
• Design tasks involving bug fixes, feature implementation, refactoring, and performance optimization.
• Build deterministic verification and testing processes to evaluate solutions.
• Develop high-quality reference or golden solutions for benchmarking.
• Ensure environments are reproducible, reliable, and representative of real-world engineering workflows.
• Analyze complex codebases and identify meaningful engineering challenges.
• Document tasks, solutions, and evaluation criteria clearly.

Skills

C++

Python

Java

Go

TypeScript

Rust

Job description

Cross Border Talents is seeking an AI Engineer for a fully remote contractor role. You will evaluate and improve next-generation AI systems by designing realistic programming tasks that test an AI model's reasoning and coding abilities.

You'll create reinforcement learning environments, build reproducible test environments, and develop reference solutions to benchmark AI agents. Strong software engineering experience is the primary qualification; prior AI experience is not required.