Frontier AI Simulation & Evaluation Architect

Collinear AI; Sunnyvale, Northern (CA, KY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Collinear AI is seeking a Member of Technical Staff (MTS - Research) to bridge frontier research and production engineering in Sunnyvale, CA. You will develop high-fidelity environments and evaluation stacks for stress-testing agents against real-world metrics.

You will iterate on novel RL approaches and translate them into scalable infrastructure, collaborating daily with the founders and research staff to advance AI reliability and impact.

Qualifications

• A Bachelor’s, Master’s, or PhD in a technical field (CS, Math, Physics, etc.) or demonstrated open-source contributions or industry experience.
• A strong foundation in software engineering with the ability to build robust, scalable infrastructure.
• A principled understanding of foundation models, including how they are constructed, evaluated, and optimized.
• Experience conducting research or technical experiments with a focus on reproducibility and data-driven results.

Responsibilities

• Build Agentic Environments: Design and implement the next generation of SimLabs, ultra-realistic, long-horizon simulation environments.
• Programmatic Verification: Develop rigorous, policy-aware judges and evaluations that measure genuine capability and safety.
• Close the Loop: Design and execute high-quality post-training runs (CPT, SFT, RL) for frontier performance on open-source models.
• Rapid Iteration: Debug and iterate across the ML stack, from infrastructure to model behavior, CLI-first.
• Collaborate: Work daily with the founders and research staff to shape the roadmap and push state-of-the-art in AI reliability.

Skills

Python

CLI-first development

Reinforcement Learning

Research mindset

Education

Bachelor’s, Master’s, or PhD in CS/Math/Physics or related field

Job description

Collinear AI is seeking a Member of Technical Staff (MTS - Research) to bridge frontier research and production engineering in Sunnyvale, CA. You will develop high-fidelity environments and evaluation stacks for stress-testing agents against real-world metrics.

You will iterate on novel RL approaches and translate them into scalable infrastructure, collaborating daily with the founders and research staff to advance AI reliability and impact.