Onsite Research Engineer Intern: AI Data & Evaluation

Mercor; San Francisco (CA); Vor Ort; USD 180.000 - 240.000; Vollzeit

Benefits dieser Stelle

Health benefits

Overtime policy (1.5x 40–55h; 2x >55h)

Meals stipend $1.5K/mo

Relocation & Housing support

Equinox membership

Laundry reimbursement

Wellness reimbursement

Zusammenfassung

Mercor is seeking a Research Engineer in San Francisco with a strong applied research background to advance post-training and evaluation for frontier language models. You will contribute to RLVR, synthetic data generation, and large-scale evaluation workflows that directly impact model performance.

You will design experiments, build scalable data pipelines, and collaborate with researchers to push the boundaries of LLM tool-use and real-world reasoning.

Qualifikationen

• Strong applied research background with a focus on post-training and/or model evaluation.
• Strong coding proficiency and hands-on experience with ML models.
• Solid understanding of data structures, algorithms, backend systems, and core engineering fundamentals.
• Familiarity with APIs, SQL/NoSQL databases, and cloud platforms.
• Ability to reason deeply about model behavior, results, and data quality.

Aufgaben

• Work on post-training and RLVR pipelines to understand how datasets, rewards, and training strategies affect model performance.
• Design and run reward-shaping experiments and algorithmic improvements (e.g., GRPO, DAPO) to improve LLM tool-use and reasoning.
• Quantify data usability, quality, and performance uplift on key benchmarks.
• Build and maintain data generation and augmentation pipelines that scale with training needs.
• Create and refine rubrics, evaluators, and scoring frameworks to guide training and evaluation decisions.
• Build and operate LLM evaluation systems, benchmarks, and metrics at scale.
• Collaborate with AI researchers, applied AI teams, and training data experts.

Kenntnisse

Applied research

Coding proficiency

Data structures

APIs

SQL/NoSQL

Cloud platforms

Model reasoning

Jobbeschreibung

Mercor is seeking a Research Engineer in San Francisco with a strong applied research background to advance post-training and evaluation for frontier language models. You will contribute to RLVR, synthetic data generation, and large-scale evaluation workflows that directly impact model performance.

You will design experiments, build scalable data pipelines, and collaborate with researchers to push the boundaries of LLM tool-use and real-world reasoning.