Annotations Portfolio Lead

We Love AI Jobs; San Francisco (CA); On-site; USD 165,000 - 210,000; Full time

Job summary

We Love AI Jobs is seeking an experienced Portfolio Lead for Physical Intelligence in San Francisco to manage multiple annotation programs end-to-end. You will work with researchers to translate data needs into clear requirements, drive quality improvements, and balance speed with accuracy in a fast-paced, on-site environment.

You will collaborate across researchers, engineers and vendors, shaping scalable processes, setting rubrics, and ensuring reliable labeled data for model development.

Qualifications

• 5+ years in program management or related operations.
• Strong understanding of data quality and annotation needs.
• Experience with model training and evaluation workflows.
• Proven ability to align researchers, engineers and stakeholders.

Responsibilities

• Own end-to-end performance for a portfolio of annotation programs.
• Collaborate with researchers to define and refine annotation requirements.
• Identify operational issues and implement scalable improvements.
• Foster clarity and alignment across technical and nontechnical stakeholders.

Skills

Program management

Data annotation

Data quality

Model training and evaluation

Operations improvement

Stakeholder management

Coding agents

Job description

# Annotations Portfolio LeadPhysical IntelligenceSan FranciscoFull-timeUpload your resume once and Scout applies for youApply with ScoutShare this job:LinkedInXSave imageYou’ll own the performance of multiple annotation programs, translating researchers’ data needs into clear requirements and running the work that delivers labeled data. The role combines hands-on operations with improving quality, speed, and consistency across the annotation function.* Permanent* On-site* 5+ years### Skills and expertiseProgram managementData annotationData qualityModel training and evaluationOperations improvementStakeholder managementCoding agents### Key responsibilities* Manage quality, speed, and efficiency across a portfolio of annotation programs.* Work with researchers to define and refine annotation requirements and rubrics.* Identify operational issues and implement scalable improvements across annotation programs.## How this job comparesCompared with 142 open lead operations jobs on October 10, 2026.Pay: This job does not publish its pay. The 62 open lead operations jobs that publish US pay start at $165K a year on average.Similar open jobs: We Love AI Jobs lists 142 open lead operations jobs at 72 companies.Remote work: This job is on site. 10 of the 142 lead operations jobs (7%) are remote.AI in this role: Medium. The role uses AI tools and works with AI systems as a regular part of the job. The annotation programs directly support model development, and the role works with researchers to understand data needs and model training and evaluation.## Full descriptionWho We ArePhysical Intelligence is bringing general-purpose AI into the physical world. We are a group of engineers, scientists, roboticists, and company builders developing foundation models and learning algorithms to power the robots of today and the physically-actuated devices of the future.The TeamHigh-quality data is the fuel for our work. The Annotations team produces high-quality data labels to support model development.This role is a hands-on owner for a portfolio of annotation programs: partnering with researchers to understand what data they need and why, translating that into concrete requirements and rubrics, and running the operation that delivers the data. This person will also be expected to drive continuous improvement across multiple surfaces to mature the annotations function and balance strategic problem solving with tactical execution.In this role you will• Own end-to-end performance for a portfolio of annotation programs, driving quality, speed, and efficiency• Partner with researchers to define and refine requirements• Drive step-function continuous improvement in our operations, identifying issues and building scalable solutions• Foster clarity, collaboration, and alignment across both technical and nontechnical stakeholders, including vendor partners, researchers, operationsWhat we hope you'll bring• 5+ years of experience in program management, operations, technical project management, consulting, startup operations, or similar roles• Strong problem solving and systems thinking; ability to identify points of leverage in a constantly-evolving system and diagnose problems with incomplete information• Intuition for data quality and research needs, grounded in understanding of model training and evaluation• Stellar communication and ability to clarify nuance, structure complex information in digestible ways, and work with remote, ESL audiences• Organizational skills to bring structure to chaos and balance needs across multiple programsBonus points• Experience with data annotations for ML/AI, having seen versions of this problem before• Experience with robotics, egocentric video, or other multimodal sensor data• Experience with using coding agents to fill gaps in tooling / infraUpload your resume once and Scout applies for youApply with Scout