Remote Research Engineer - Frontier AI Platform

Prime Intellect, Inc.; United States; On-site; USD 150,000 - 350,000; Full time

Benefits offered by this job

Visa sponsorship

Relocation assistance

Remote work option

Quarterly team off-sites

Competitive cash compensation

Job summary

Prime Intellect, Inc. is building the open frontier AI stack and open frontier models. The role focuses on taking architecture experiments to full pretraining runs, scaling toward very large parameter counts, and solving systems problems that determine run success.

You will work across the model and training stack with researchers and engineers. You will evaluate MoE and attention designs, profile training jobs for throughput, and ensure reproducibility of experiments while pushing toward

Qualifications

• Hands-on experience training language models, including modifying training code and following the effects through actual runs.
• Strong Python skills and experience with PyTorch or a comparable framework, with enough systems understanding to debug distributed training.
• A practical understanding of model architectures and optimization, including their effect on convergence.
• Ability to design an ablation that answers a research question and explain what its results do and don’t show.
• Good judgment about what to investigate yourself and when to bring in a colleague.

Responsibilities

• Build and extend the pretraining code in prime-rl, taking small experiments into full training runs.
• Evaluate model architecture changes, including MoE and attention designs, against model quality and training cost.
• Profile training jobs and improve end-to-end throughput, working with systems engineers on hardware-aware execution.
• Make long runs resilient to failures, with reliable checkpointing and recovery.
• Investigate training dynamics and numerical stability, checking that optimizations preserve convergence.
• Run controlled ablations to guide larger experiments, keeping the setup and results reproducible.
• Work with data and evaluation researchers on training mixtures, including midtraining and long-context experiments.

Skills

Python

PyTorch

Distributed training

Research mindset

Debugging systems

Tools

prime-rl

Job description

Prime Intellect, Inc. is building the open frontier AI stack and open frontier models. The role focuses on taking architecture experiments to full pretraining runs, scaling toward very large parameter counts, and solving systems problems that determine run success.

You will work across the model and training stack with researchers and engineers. You will evaluate MoE and attention designs, profile training jobs for throughput, and ensure reproducibility of experiments while pushing toward