Staff AI Researcher: Frontier Models & Evaluations

Fdetimes; United States; On-site; USD 250,000 - 400,000; Full time

Benefits offered by this job

Health care (medical, dental, vision)

Unlimited PTO

Paid parental leave 14 weeks

Professional development

401K and equity incentives

Mental health benefits

Job summary

Red Cell Partners is launching a stealth startup focused on AI for mission‑critical organizations. We seek a Member of Technical Staff, AI Researcher to turn complex workflows into evaluation frameworks, reinforcement learning environments, and feedback systems to advance frontier AI.

This blended research‑engineering role tests ideas, builds infrastructure, and scales methods to production quality. 5+ years in ML/AI with US citizenship are required; salary ranges from $250,000–$400,000 with

Qualifications

• 5+ years of experience in ML/AI and software engineering.
• Experience designing evaluations or experiments that measure model capability, generalization, alignment, or agent performance.
• Ability to build research prototypes and develop them into production‑quality systems.
• Strong written and verbal communication of complex technical concepts.
• US citizenship is required.

Responsibilities

• Design and build evaluation frameworks, benchmarks, and methodologies for frontier LLMs, AI agents, multimodal models, and RL environments.
• Develop reward models, verifiers, graders, and other feedback systems to measure and improve model behavior.
• Conduct controlled supervised fine‑tuning and RL experiments to assess data effects on capability, generalization, and alignment.
• Research and define what makes evaluations representative of real‑world work and operational environments.
• Build systems for producing high‑quality human data, including expert task design and data attribution techniques.
• Translate research questions into lightweight experiments that yield actionable findings.
• Prototype quickly, evaluate results, diagnose failure modes, and convert findings into improved benchmarks or systems.
• Move methods from experimentation into scalable, production‑quality implementations.
• Collaborate across research, engineering, product, and operations on a shared technical roadmap.
• Contribute to the broader technical community via benchmarks, open‑source tools, research, and writing.

Skills

Python

Reinforcement learning

AI research

Evaluation frameworks

Model feedback systems

Data analysis

Technical writing

US citizenship

Education

Advanced degree in ML/AI or related field

Job description

Red Cell Partners is launching a stealth startup focused on AI for mission‑critical organizations. We seek a Member of Technical Staff, AI Researcher to turn complex workflows into evaluation frameworks, reinforcement learning environments, and feedback systems to advance frontier AI.

This blended research‑engineering role tests ideas, builds infrastructure, and scales methods to production quality. 5+ years in ML/AI with US citizenship are required; salary ranges from $250,000–$400,000 with