Staff AI Safety Engineer - Red Team & Guardrails

B Capital; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Top-tier compensation

Comprehensive medical, dental, vision, life, and disability insurance

Fully paid parental leave

Paid time off

Daily lunch and dinner provided

Job summary

B Capital in San Francisco is looking for individuals passionate about AI safety to own the red-teaming and adversarial evaluation pipeline for their models. The role involves collaborating with the Alignment team and ensuring all releases meet safety thresholds.

Candidates should have a graduate degree in Computer Science or a related field, exceptional knowledge of LLM safety, and a willingness to make high-stakes decisions. B Capital offers a competitive compensation package and comprehensive health benefits.

Qualifications

• Graduate degree or equivalent experience in AI Safety.
• Deep understanding of adversarial attacks and red-teaming methodologies.
• Experience in building automated evaluation pipelines.

Responsibilities

• Own the red-teaming and adversarial evaluation pipeline for models.
• Work with Alignment team to translate safety findings into guardrails.
• Validate releases against the lab’s risk thresholds.

Skills

Technical understanding of LLM safety

Software engineering capabilities

Experience with Reinforcement Learning

Ability to thrive in a startup environment

Education

Graduate degree (MS or PhD) in Computer Science, Machine Learning

Job description

B Capital in San Francisco is looking for individuals passionate about AI safety to own the red-teaming and adversarial evaluation pipeline for their models. The role involves collaborating with the Alignment team and ensuring all releases meet safety thresholds.

Candidates should have a graduate degree in Computer Science or a related field, exceptional knowledge of LLM safety, and a willingness to make high-stakes decisions. B Capital offers a competitive compensation package and comprehensive health benefits.