Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home

Parallel Partners, Inc.; San Francisco (CA); Remote; USD 165,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Savings plan

Paid time off

Job summary

Parallel Partners, Inc. seeks a Senior Technical Product Manager for AI Agents, Evals & Reliability. This hands-on role collaborates with ML, backend, and mobile engineers to shape AI system design, evaluation, and user impact. AI/ML experience is required and a 60-minute coding assessment is expected.

Remote work is fully supported. You will drive end-to-end AI system requirements, evaluation frameworks, and roadmap execution to deliver trusted, scalable AI capabilities for global users.

Qualifications

• Hands-on exposure to AI-powered products, including LLM-based systems.
• Experience reading, reviewing, and discussing technical design documents.
• Ability to balance model capabilities with system constraints and user impact.

Responsibilities

• Research and define AI system requirements from capability to behavior to user impact.
• Translate model/data constraints into clear product decisions.
• Make hard trade-offs across quality, latency, cost, reliability, and UX.

Skills

CS fundamentals

System design

ML fundamentals

Technical reading

Job description

Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home

• Full-time
• Compensation: USD 165,000 - USD 200,000 - yearly

Senior Technical Product Manager - AI Agents, Evals & Reliability, Artificial Intelligence (AI) Required, Work From Home

We are looking for a Senior Technical Product Manager. This is a deeply technical, hands-on role. The Senior Technical Product Manager will work directly with engineers on systems design, evaluation, and trade-offs-defining requirements, but shaping how the system works for global users. The Senior Technical Product Manager will work at the intersection of user needs, model capability, and system constraints, and are responsible for turning AI potential into real, reliable behavior in a real-world application. Artificial Intelligence (AI) and Machine Learning (ML) experience are required for this position.

This position is 100% Remote.

MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT.

Senior Technical Product Manager Responsibilities:

• Research and define end-to-end Artificial Intelligence (AI) system requirements from capability to behavior to user impact.
• Translate model capabilities, data constraints, and evaluation results into clear product and system decisions.
• Make hard trade-offs across quality, latency, cost, reliability, and User Experience (UX).
• Work closely with Machine Learning (ML), backend, and mobile engineers on system design, evaluation, and iteration.
• Define and evolve evaluation frameworks across offline metrics, online experiments, and human feedback.
• Drive execution with clear specs, strong judgment, and disciplined prioritization.
• Ensure systems ship quickly, safely, and reliably, with strong feedback loops.
• Own product quality end-to-end, including correctness, predictability, and user trust.

Outcomes:

• Product strategy clearly aligns AI capabilities with user needs and company priorities.
• Artificial Intelligence (AI) features deliver real value, are understandable, predictable, and trusted by users.
• Decisions balance quality, speed, cost, and reliability effectively under uncertainty.
• Roadmaps and priorities are clear, with fast iteration based on real user feedback.
• Teams are aligned, focused, and able to execute Artificial Intelligence (AI) product goals with minimal friction.

Senior Technical Product Manager Qualifications:

Technical Foundation:

• Strong grounding in computer science fundamentals, including algorithms, data structures, and system design.
• Solid understanding of Machine Learning (ML) fundamentals and how modern Artificial Intelligence (AI) systems behave in production.
• Comfort reading, reviewing, and discussing technical design documents.

Artificial Intelligence (AI) & Machine Learning (ML) Experience:

• Hands-on exposure to AI-powered products, including Large Language Model (LLM)-based systems.
• Experience working with model evaluation, prompt or pipeline iteration, and feedback loops.
• Strong intuition for model limitations, hallucinations, bias, and drift.
• Proven ability to work closely with senior engineers and Machine Learning (ML) teams.
• Strong judgment and decision-making ability in ambiguous, fast-moving environments.
• Ability to balance ambition with technical and operational reality.

Nice to have:

• Experience shipping AI-heavy consumer products.
• Background as an engineer or highly technical product manager.
• Strong intuition for Artificial Intelligence (AI) User Experience (UX) patterns and failure handling.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords: San Francisco CA Jobs, AI, Artificial Intelligence, AI Agents, Algorithms, Backend, Computer Science Fundamentals, Data Structures, LLM, Large Language Model, ML, Machine Learning, Senior Technical Product Manager, System Design, UX, User Experience, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting

All your information will be kept confidential according to EEO guidelines.