Remote Senior AI PM, Evals & Annotations

Arize AI; United States; Remote; USD 200,000 - 250,000; Full time

Benefits offered by this job

WFH stipend

Remote-friendly

Office options in NYC & SF

Job summary

Arize AI is seeking a Senior AI Product Manager for Evals & Annotations. The role is remote in the United States, with potential in-office options in NYC/SF. You will own the evaluation lifecycle, drive strategy, and collaborate with Design/Engineering to ship best-in-class experiences.

The position emphasizes technical depth, UX leadership, and close customer collaboration to shape the future of AI evaluation workflows within a rapidly evolving platform.

Qualifications

• Significant product management experience owning technically complex developer-facing products.
• Strong understanding of LLM evaluations and AI development workflows.
• Experience with developer tools, AI infrastructure, ML platforms, or adjacent technical products.
• Hands-on engineering ability: debug, small fixes, prototypes, tech tradeoffs.

Responsibilities

• Own Arize's Evals & Annotations product area end-to-end, including creation and execution, human review, annotation workflows, and lifecycle.
• Set the product strategy and roadmap balancing customer needs, UX, and platform investments.
• Prototype solutions and partner with Design to deliver intuitive experiences.

Job description

Arize AI is seeking a Senior AI Product Manager for Evals & Annotations. The role is remote in the United States, with potential in-office options in NYC/SF. You will own the evaluation lifecycle, drive strategy, and collaborate with Design/Engineering to ship best-in-class experiences.

The position emphasizes technical depth, UX leadership, and close customer collaboration to shape the future of AI evaluation workflows within a rapidly evolving platform.