AI Systems PM: Scalable Evaluation & Learning

Agilesoft; San Francisco (CA); On-site; USD 160,000 - 240,000; Full time

Benefits offered by this job

Competitive salary and equity

Performance bonus

401(k) with company match

Health coverage

Unlimited PTO

Daily catered meals in Mountain View

Job summary

Granica is hiring a Research Product Manager to define and build core systems that determine how AI models are evaluated, improved, and deployed on real-world data. You’ll own systems spanning model evaluation, post-training feedback loops, and learning from structured data, blending ML infrastructure, research, and product.

Location Mountain View, CA; on-site five days per week; senior/principal level. You’ll work with researchers and engineers to move ideas from experiments into production at

Qualifications

• 5+ years of experience in product management, technical program management, or similar roles in AI, ML infrastructure, or data systems.
• Strong understanding of machine learning systems, including training, evaluation, and deployment.
• Experience working with large-scale data systems or distributed infrastructure.
• Ability to reason about trade-offs across data, compute, performance, and cost.
• Track record of driving complex technical systems from concept to production.

Responsibilities

• Define and drive systems for model evaluation, benchmarking, and real-world performance.
• Build product direction for post-training systems and feedback loops that continuously improve models.
• Define how models learn from large-scale structured and relational datasets.
• Partner with engineering to build systems that connect data platforms with ML systems.
• Own how improvements move from research experiments into production systems.
• Model trade-offs across compute, data efficiency, performance, and cost.
• Identify where system improvements drive measurable business impact.

Skills

Product management

ML infrastructure

Data systems

Trade-off analysis

Production rollout

Job description

Granica is hiring a Research Product Manager to define and build core systems that determine how AI models are evaluated, improved, and deployed on real-world data. You’ll own systems spanning model evaluation, post-training feedback loops, and learning from structured data, blending ML infrastructure, research, and product.

Location Mountain View, CA; on-site five days per week; senior/principal level. You’ll work with researchers and engineers to move ideas from experiments into production at