AI RL & Evaluations Engineer — Creative Domain Systems

Raydar; San Francisco (CA); On-site; USD 175,000 - 275,000; Full time

Benefits offered by this job

Competitive equity

Job summary

Raydar in San Francisco is seeking an AI Engineer, RL & Evals to design and deploy reinforcement learning environments, evaluation frameworks, and production-grade infrastructure for creative domains. You will blend backend engineering with applied ML and own the systems from design through delivery.

The role requires 2–7 years in AI/RL, strong backend or full-stack capabilities, Python, PyTorch, RL and ML evaluation frameworks, distributed data pipelines, a CS degree, fluent English, and the

Qualifications

• 2–7 years of AI or reinforcement learning engineering experience.
• Strong full-stack or backend engineering skills with production shipping experience.
• Proficiency in Python, PyTorch, RL, ML evaluation frameworks and LLMs.

Responsibilities

• Build and scale RL environments and evaluation frameworks for creative, non-verifiable domains.
• Design tasks and grading rubrics that capture design quality and taste.
• Build agent harnesses, context layers and supporting product infrastructure.
• Collaborate with internal research teams and frontier labs to improve model output quality.
• Ship production code end to end and build reliable backend systems and data pipelines.

Skills

Full-stack eng

Python

PyTorch

RL engineering

LLMs

Distributed systems

Education

CS degree

Job description

Raydar in San Francisco is seeking an AI Engineer, RL & Evals to design and deploy reinforcement learning environments, evaluation frameworks, and production-grade infrastructure for creative domains. You will blend backend engineering with applied ML and own the systems from design through delivery.

The role requires 2–7 years in AI/RL, strong backend or full-stack capabilities, Python, PyTorch, RL and ML evaluation frameworks, distributed data pipelines, a CS degree, fluent English, and the