Forward‑Deployed AI Behavior Engineer

Transluce; San Francisco (CA); On-site; USD 310,000 - 500,000; Full time

Job summary

Transluce, located in San Francisco, seeks an engineer to develop and measure AI model behaviors. In this role, you'll engage with policymakers and civil partners to address key questions regarding AI systems. Responsibilities include building evaluation methods and adapting them for various contexts. The ideal candidate possesses hands-on experience with AI evaluations, strong engineering instincts, and the ability to translate complex needs into actionable solutions. This position is open to sponsoring international visas.

Qualifications

• Hands-on experience designing and running AI evaluations, particularly behavioral or interactive evaluations.
• Strong engineering instincts and good judgment about when ‘good enough to ship’ is actually good enough.
• Experience translating ambiguous stakeholder needs into concrete deliverables.
• Experience running evaluations at scale or in a production context.
• Ability to balance needs between researchers and senior decision makers.
• Strong communication skills, openness to feedback.

Responsibilities

• Build and extend Transluce’s AI evaluation methods for measuring evolving AI model behaviors.
• Prototype and run behavioral evaluations for policy and oversight needs.
• Execute on contracts with government evaluators and build evaluations for harmful manipulation.
• Design and run privileged-access evaluations with frontier labs.
• Adapt behavioral evaluation pipelines to contexts like mental health and persuasion.

Skills

Experience designing and running AI evaluations

Strong engineering instincts

Experience in customer-facing roles

Ability to balance needs of stakeholders

Strong communication skills

Job description

Transluce, located in San Francisco, seeks an engineer to develop and measure AI model behaviors. In this role, you'll engage with policymakers and civil partners to address key questions regarding AI systems. Responsibilities include building evaluation methods and adapting them for various contexts. The ideal candidate possesses hands-on experience with AI evaluations, strong engineering instincts, and the ability to translate complex needs into actionable solutions. This position is open to sponsoring international visas.