AI Code Auditor – Real-World Engineering Tasks

Planet Pharma; San Francisco (CA); On-site; USD 90,000 - 130,000; Full time

Job summary

Planet Pharma is seeking an AI Trainer – Coding in San Francisco, CA, to design and evaluate realistic software engineering tasks for AI agents. You will craft scenarios from your practice, including bug fixes, specs, and PR reviews, then run them through frontier AI agents and judge outputs against a professional standard.

The role is on-site in San Francisco and requires strong engineering judgment. The position emphasizes explicit written reasoning and working with real production-like files,

Qualifications

• 2+ years of professional software engineering experience preferred.
• In progress Bachelor’s degree or higher.
• Expertise in at least one major stack (JS/TS, Python, Java, Go, Rust, C++, C#, Ruby, PHP, Swift, Kotlin).
• Proficient in terminal usage, Git, tests, and a debugger; Docker and CI experience is a plus.
• Strong ability to read unfamiliar codebases and articulate reasoning in writing.
• English: full professional proficiency in speaking and writing.

Responsibilities

• Design realistic software engineering tasks drawn from day-to-day work.
• Run tasks through AI coding agents and evaluate accuracy against professional standards.
• Compare agent outputs on identical specs and document gaps.
• Create tests, rubrics, and success criteria for correct deliverables.
• Flag failures with concrete evidence and align on fix strategies.
• Contribute across the stack and review tasks created by others.

Skills

JavaScript/TypeScript

Python

Java

Go

Rust

C++

C#

Ruby

PHP

Swift

Kotlin

Education

Bachelor’s degree or higher

Tools

Docker

CI/CD

Git

Job description

Planet Pharma is seeking an AI Trainer – Coding in San Francisco, CA, to design and evaluate realistic software engineering tasks for AI agents. You will craft scenarios from your practice, including bug fixes, specs, and PR reviews, then run them through frontier AI agents and judge outputs against a professional standard.

The role is on-site in San Francisco and requires strong engineering judgment. The position emphasizes explicit written reasoning and working with real production-like files,