RL & Evaluations Engineer for Creative AI Systems

raydar; California; On-site; USD 175,000 - 275,000; Full time

Benefits offered by this job

Competitive equity

Job summary

raydar seeks an AI Engineer focused on reinforcement learning and evaluations to build production systems that help models improve on subjective tasks. You will design RL environments, evaluation frameworks, and agent harnesses, collaborating with research teams to ship backend and data pipelines.

The role requires strong Python and PyTorch skills, RL/LLMs exposure, and a CS degree. On-site at our SF office, with generous equity and impact on cutting-edge AI evaluation infrastructure.

Qualifications

• Requires a CS degree and practical software development experience.
• Proficient in Python and PyTorch for ML workflows.
• Experience building RL environments and evaluation systems.
• Familiarity with distributed systems and backend services.
• English communication across engineering and research teams.

Responsibilities

• Build reinforcement learning environments and evaluation frameworks for creative tasks.
• Design tasks and rubrics to measure quality in subjective domains.
• Develop agent harnesses and context layers for API and product infra.
• Collaborate with research to create environments improving model output.
• Ship production software end-to-end, including data pipelines.

Skills

Python

PyTorch

Reinforcement learning

LLMs

Distributed systems

Backend engineering

Education

Bachelor's degree in Computer Science

Job description

raydar seeks an AI Engineer focused on reinforcement learning and evaluations to build production systems that help models improve on subjective tasks. You will design RL environments, evaluation frameworks, and agent harnesses, collaborating with research teams to ship backend and data pipelines.

The role requires strong Python and PyTorch skills, RL/LLMs exposure, and a CS degree. On-site at our SF office, with generous equity and impact on cutting-edge AI evaluation infrastructure.