Sr AI Product Owner

CodeRoad Inc; United States; Teletrabalho; USD 140 000 - 180 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work

Holidays off

PTO

Health insurance assistance

USD compensation

Growth opportunities

Resumo da oferta

CodeRoad Inc. is seeking an AI Product Owner to anchor discovery, strategy, and execution of AI-powered solutions for an enterprise client.

You will lead a high-performing cross-functional POD—comprising AI research, data engineering, front-end development, and DevOps—shaping raw business requirements into production-grade LLM applications. This role drives feature scope, evaluation benchmarks, and system performance standards, ensuring secure, compliant, and scalable AI agents and RAG

Qualificações

• 4+ years as Product Owner or Product Manager delivering software with LLM-powered applications.
• Deep understanding of LLM evaluation methodologies, prompt engineering, guardrails, and telemetry metrics.
• Strong technical depth to evaluate model selection, data access patterns, vector search, and security considerations.
• Experience using Jira and Confluence to document technical user stories, decision logs, and API/data requirements.
• Proven client-facing consulting or senior stakeholder management with an ownership mindset.
• Advanced English fluency (C1+) for collaboration with North American client partners.

Responsabilidades

• Own the AI Product Backlog & Strategy: identify and prioritize AI use cases based on value, feasibility, and data readiness.
• Establish AI Quality & Evaluation Frameworks: curate evaluation datasets, monitor outputs, address hallucination risks, and sign off on releases.
• Orchestrate Delivery Across Cross-Functional PODs: plan, groom, and scope releases with engineers and architects.
• Drive Stakeholder & Compliance Alignment: run workshops, demos, and secure data privacy sign-offs in compliant environments.
• Manage Project Operations & Risk: track milestones, cloud/LLM costs, and maintain a risk register.

Conhecimentos

Jira

Confluence

Agile

English (C1+)

Stakeholder mgmt

AI/LLM basics

Prompt engineering

Observability metrics

Data security

Ferramentas

Azure AI

Descrição da oferta de emprego

CodeRoad provides end-to-end software development services, helping businesses scale with ideal infrastructure solutions. From staff augmentation to dedicated IT teams and general software engineering, our nearshore technology services empower businesses to thrive in an ever-evolving digital landscape.

About the Role

As an AI Product Owner at CodeRoad, you will anchor the discovery, strategy, and execution of cutting-edge AI-powered solutions for our enterprise client. You will lead a high-performing cross-functional POD—comprising AI research, data engineering, front-end development, and DevOps talent—shaping raw business requirements into robust, production-grade LLM applications. Working at the intersection of AI orchestration, enterprise data access, and strict compliance environments, you will establish what "good" looks like by driving feature scope, quality evaluation benchmarks, and system performance standards.

This role is critical to successfully delivering secure, highly compliant, and scalable AI agents and RAG implementations. By bridging the gap between non-technical business leaders and technical engineering teams, you will turn complex AI capabilities into tangible business ROI while managing project roadmaps, risk mitigation strategies, and cloud consumption budgets.

Key Responsibilities

• Own the AI Product Backlog & Strategy: Identify, define, and prioritize AI use cases based on business value, technical feasibility, and data readiness, translating user needs into granular stories with rigorous acceptance criteria and edge-case handling.
• Establish AI Quality & Evaluation Frameworks: Collaborate with business experts to curate golden evaluation datasets, review agent outputs, monitor hallucination risks, and iterate on prompts, guardrails, and context retrieval systems to sign off on release readiness.
• Orchestrate Delivery Across Cross-Functional PODs: Anchor sprint planning, grooming, and release scoping with engineers and architects to balance rapid innovation with operational stability, cost control, and performance latency.
• Drive Stakeholder & Compliance Alignment: Serve as the primary contact for client leadership, running workshops, conducting feature demos, and securing necessary data-privacy and governance sign-offs in compliance-sensitive environments.
• Manage Project Operations & Risk Log: Proactively manage milestones, track cloud/LLM costs against budget, and maintain an updated risk register encompassing model drift, data latency, and infrastructure dependencies.

Requirements

• 4+ years of hands-on experience as a Product Owner or Product Manager delivering software products, with direct experience shipping LLM-powered applications (e.g., AI agents, RAG architectures, document extraction, conversational AI).
• Deep understanding of LLM evaluation methodologies, prompt engineering workflows, guardrail implementations, and observability/telemetry metrics (accuracy, latency, token consumption).
• Strong technical depth to evaluate engineering trade-offs around model selection, data access patterns, vector search, and infrastructure security with AI and data engineers.
• Demonstrated experience operating within Agile environments utilizing tools like Jira and Confluence to document technical user stories, decision logs, and API/data requirements.
• Proven track record in client-facing consulting or senior stakeholder management, displaying an ownership mindset and executive-level delivery skills.
• Advanced English fluency (C1+ spoken and written) for seamless collaboration with North American client partners.

Nice to Have

• Experience building AI solutions within Financial Services or heavily regulated sectors subject to data privacy and information barriers.
• Hands-on familiarity with Azure AI ecosystem and the broader Microsoft enterprise data stack.
• Operational experience working with client-side Managed Service Providers (MSPs) and third-party IT outsourcers.
• Exposure to modern AI orchestration frameworks (e.g., LangChain, LlamaIndex, AutoGen) and LLM observability tools (e.g., LangSmith, Phoenix, Arize).

What You’ll Love

• 100% Remote work flexibility
• Holidays off aligned with your country’s calendar
• Paid Time Off (PTO)
• Health insurance assistance
• Competitive USD compensation
• Growth opportunities in a fast-scaling tech environment