Frontier AI Evaluation Architect

Reinforced Learning; Town of Tonawanda (NY); On-site; USD 140,000 - 210,000; Full time

Job summary

Reinforced Learning seeks Research Scientists to design and publish rigorous evaluations for frontier AI systems. You will lead end-to-end evaluation development across agentic, coding, and safety domains and work with experts in healthcare, STEM, and finance to close important capability gaps with public research.

You will own evaluation development, publish benchmark results, and contribute to reproducible research practices across disciplines.

Qualifications

• Proven ability to publish benchmarks or research papers.
• Strong scientific writing and communication.
• Commitment to experimental rigor with baselines and ablations.

Responsibilities

• Lead end-to-end design, validation and launch of frontier AI benchmarks.
• Collaborate with researchers to develop evaluations around model failures and domain gaps.
• Analyze capabilities and failure modes using rigorous experimental methods.
• Build reproducible evaluation systems and infrastructure.
• Communicate results via reports and research papers.

Skills

Research publications

Technical writing

Experimental design

Reproducible research practices

Education

PhD in a related field

Job description

Reinforced Learning seeks Research Scientists to design and publish rigorous evaluations for frontier AI systems. You will lead end-to-end evaluation development across agentic, coding, and safety domains and work with experts in healthcare, STEM, and finance to close important capability gaps with public research.

You will own evaluation development, publish benchmark results, and contribute to reproducible research practices across disciplines.