RL Research Scientist: Reasoning & Autoformalization

Pramaana Labs; Palo Alto (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Pramaana Labs, a Palo Alto AI lab, is seeking an RL Post-Training Researcher to scale reasoning capabilities of foundation models. You will apply RLVR to new domains, use Lean-derived rewards, and push autoformalization and proving through novel RL algorithms and data evals.

You will own the full loop from rollout to evaluation. Ideal candidates will have deep RL research experience at scale, expertise with deterministic reward signals, and a strong systems mindset to build robust evals with

Qualifications

• Deep, hands-on research experience in reinforcement learning applied to reasoning models at scale.
• Experience working with RLVR, test-time RL, or exact deterministic reward signals.
• Strong algorithmic and systems intuition — comfortable writing custom RL loops, managing data pipelines, and building robust evals from scratch.
• High autonomy: the ability to take a fuzzy problem area and independently drive it to state-of-the-art results without day-to-day direction.

Responsibilities

• Scale RLVR to new, real-world domains using the Lean kernel as a deterministic reward signal.
• Design and implement novel RL algorithms and test-time compute optimizations tailored for formal environments and proof search.
• Push the frontier of autoformalization, training models to map highly technical natural language into strict formal specifications.
• Curate data and build evals that tightly correlate with verifiable downstream reasoning capabilities.
• Own the whole loop: rollout sampling, reward design, the update, the eval.

Skills

Reinforcement learning

RLVR

Custom RL loops

Tools

Lean

Coq

Isabelle

Job description

Pramaana Labs, a Palo Alto AI lab, is seeking an RL Post-Training Researcher to scale reasoning capabilities of foundation models. You will apply RLVR to new domains, use Lean-derived rewards, and push autoformalization and proving through novel RL algorithms and data evals.

You will own the full loop from rollout to evaluation. Ideal candidates will have deep RL research experience at scale, expertise with deterministic reward signals, and a strong systems mindset to build robust evals with