Remote AI Evaluation Engineer (Contractor)

Cross Border Talents; New York (NY); On-site; USD 83,000 - 165,000; Full time

Benefits offered by this job

Flexible schedule

Fully remote

Competitive pay

Job summary

Cross Border Talents is seeking an AI Engineer contractor to evaluate and improve next-generation AI systems. You will design realistic software engineering tasks and reinforcement learning environments to test how AI models reason and code.

This fully remote, flexible role emphasizes strong general software engineering skills over prior AI experience. Open to developers who can work independently in a distributed team, the position offers hourly pay of $60–$120, with up to 100 openings and a

Qualifications

• Strong proficiency in one or more of C++, Python, Java, Go, TypeScript, or Rust.
• Solid understanding of algorithms, data structures, and software engineering fundamentals.
• Demonstrated experience debugging complex software issues.
• Strong experience developing features and refactoring existing codebases.
• Experience with performance optimization and scalability.
• Excellent written and verbal communication skills.
• Strong attention to detail and ability to produce reliable, high-quality work.
• Ability to work independently and collaborate effectively in a remote environment.

Responsibilities

• Create realistic software engineering tasks for AI model evaluation.
• Develop reinforcement learning environments using Model Context Protocol (MCP) tools.
• Design tasks involving bug fixes, feature implementation, refactoring, and performance optimization.
• Build deterministic verification and testing processes to evaluate solutions.
• Develop high-quality reference or golden solutions for benchmarking.
• Ensure environments are reproducible, reliable, and representative of real-world engineering workflows.
• Analyze complex codebases and identify meaningful engineering challenges.
• Document tasks, solutions, and evaluation criteria clearly.

Skills

C++, Python, Java, Go, TypeScript, or 

Job description

Cross Border Talents is seeking an AI Engineer contractor to evaluate and improve next-generation AI systems. You will design realistic software engineering tasks and reinforcement learning environments to test how AI models reason and code.

This fully remote, flexible role emphasizes strong general software engineering skills over prior AI experience. Open to developers who can work independently in a distributed team, the position offers hourly pay of $60–$120, with up to 100 openings and a