Senior Product Manager - AI Trust & Transparency

Athenahealth India; Boston (MA); On-site; USD 141,000 - 239,000; Full time

Job summary

athenahealth in Boston, MA, is seeking a Senior Product Manager to lead the AI Trust & Transparency portfolio. You will shape evaluation, governance, and transparency across clinical AI products, partnering with a broad cross‑functional team in a hybrid work environment.

The role emphasizes end-to-end product ownership, collaboration with Legal, Safety, and Sales, and driving responsible AI practices across regulated healthcare products. Strong communication and Agile experience are essential.

Qualifications

• 8+ years of relevant experience, incl. 4+ years in product management.
• Experience with large language model evaluation methods.
• Experience with responsible AI solutions in regulated environments.
• Strong written and verbal communication with cross-functional partners.

Responsibilities

• Define product vision, strategy, and multi‑release roadmap for AI Trust & Transparency.
• Lead end-to-end product development lifecycle and OKRs.
• Act as Product Owner, prioritize backlog and trade‑offs.
• Determine need for experiments to assess Product‑Market fit.
• Establish and monitor performance measures for product outcomes and risks.
• Collaborate with cross‑functional teams to align priorities with healthcare needs.
• Guide prioritization with market, customer needs, and dependencies.
• Support teams in applying AI evaluation tools and governance practices.

Skills

LLM evaluation methods

Deterministic testing

Human annotation

Model governance

Agile Scrum

Stakeholder communication

Tools

Arize

Kubeflow

LangSmith

Datadog

Braintrust

Job description

Position Summary

Join us as we work to create a thriving ecosystem that delivers accessible, high-quality, and sustainable healthcare for all. Position Summary Help shape how trustworthy AI is designed, evaluated, and communicated across athenahealth’s clinical products. The Senior Product Manager will lead the AI Trust & Transparency product area, developing evaluation, governance, and transparency capabilities that support safe, effective AI experiences for clinicians and administrators. This role is based in Boston, MA and operates in a hybrid work environment. This role reports to the Product Management Director within athenaClinicals.

About the Team

The Clinical Foundations team builds shared capabilities that support athenahealth’s electronic health record products. The team serves both internal stakeholders building AI-powered clinical products and clients who need confidence in those products. This includes developing AI evaluation methods, governance, and systems for demonstrating performance and trustworthiness to clinicians, administrators, clients, and prospects. Team members partner with Product, Engineering, Design, Data Science, Patient Safety, Legal, Sales, Customer Success, and Product Marketing, while working with scrum teams in Boston and India. The team uses AI evaluation and observability platforms such as Arize and Kubeflow to assess solutions built with third‑party large language models and internally developed machine learning models.

Essential Job Responsibilities

• Define the product vision, strategy, business cases, and multi‑release roadmap for the AI Trust & Transparency area.
• Lead the end-to‑end product development lifecycle, including problem definition, requirements, user experience, objectives and key results, delivery, and measurement of customer and business outcomes.
• Serve as Product Owner for assigned scrum teams by defining epics and user stories, prioritizing the backlog, and making informed trade‑offs among customer value, scope, timing, and technical constraints.
• Determine whether experiments, alpha, and/or beta stages are needed to determine Product‑Market fit and appropriately define and utilize them.
• Establish and monitor performance measures that provide visibility into product outcomes, risks, and opportunities for improvement.
• Partner with Product, Engineering, Design, Data Science, Patient Safety, Legal, and business leaders to align product decisions with healthcare safety, regulatory, and operational needs.
• Evaluate market conditions, customer needs, product dependencies, and business value to guide prioritization and product investment decisions.
• Collaborate with Sales, Customer Success, and Product Marketing to develop clear customer‑facing product information and service descriptions.
• Support product teams in applying shared AI evaluation tools and governance practices to their business areas.
• Share product management and responsible AI practices with colleagues through coaching, documentation, and working sessions.
• Contribute to planning and coordination across the broader Product Management organization.

Expected Education & Experience

• At least 8 years of relevant professional experience, including 4 or more years in product management.
• Practical experience with large language model evaluation methods, such as deterministic testing, model‑based evaluation, human annotation workflows, and online evaluation.
• Experience with LLM evaluation methods (such as deterministic evaluations, LLM‑as‑Judge approaches, human annotation workflows, and online evaluations), machine learning, AI model card building, or evaluation and observability platforms such as Arize, Datadog, LangSmith, or Braintrust.
• Experience designing or managing responsible AI solutions in regulated or high‑impact environments, including safety testing, hallucination risk management, bias evaluation, auditability, data lineage, or compliance.
• Knowledge of modern AI systems and practices, including large language models, retrieval‑augmented generation architecture, AI agents, observability, evaluation pipelines, model governance, prompt engineering, explainability, traceability, and production AI operations.
• Experience working with Agile or Scrum product development teams.
• Ability to analyze complex problems, use qualitative and quantitative evidence, and develop scalable product solutions.
• Clear written and verbal communication skills for working with customers, senior leaders, and cross‑functional partners.
• Experience using AI tools (e.g., Claude, Copilot, ChatGPT, Figma Make) to accelerate product development work, such as draft requirements, synthesize user feedback, create specifications or prototypes, or analyze data with appropriate human review.

Preferred

Knowledge of healthcare technology, electronic health records, or clinical workflows.

Expected Compensation

Expected Compensation $141,000 - $239,000

The base salary range shown reflects the full range for this role from minimum to maximum. At athenahealth, base pay depends on multiple factors, including job‑related experience, relevant knowledge and skills, how your qualifications compare to others in similar roles, and geographical market rates. Base pay is only one part of our competitive Total Rewards package - depending on role eligibility, we offer both short and long‑term incentives by way of an annual discretionary bonus plan, variable compensation plan, and equity plans.

About athenahealth

Our vision: In an industry that becomes more complex by the day, we stand for simplicity. We offer IT solutions and expert services that eliminate the daily hurdles preventing healthcare providers from focusing entirely on their patients — powered by our vision to create a thriving ecosystem that delivers accessible, high‑quality, and sustainable healthcare for all.

Our company culture

Our talentedemployees — or athenistas, as we call ourselves — spark the innovation and passion needed to accomplish our vision. We are a diverse group of dreamers and do‑ers with unique knowledge, expertise, backgrounds, and perspectives. We unite as mission‑driven problem‑solvers with a deep desire to achieve our vision and make our time here count. Our award‑winning culture is built around shared values of inclusiveness, accountability, and support.

Our DEI commitment

Our vision of accessible, high‑quality, and sustainable healthcare for all requires addressing the inequities that stand in the way. That’s one reason we prioritize diversity, equity, and inclusion in every aspect of our business, from attracting and sustaining a diverse workforce to maintaining an inclusive environment for athenistas, our partners, customers and the communities where we work and serve.

What we can do for you

Along with health and financial benefits, athenistas enjoy perks specific to each location, including commuter support, employee assistance programs, tuition assistance, employee resource groups, and collaborativeworkspaces — some offices even welcome dogs. We also encourage a better work‑life balance for athenistas with our flexibility. While we know in‑office collaboration is critical to our vision, we recognize that not all work needs to be done within an office environment,full‑time. With consistent communication and digital collaboration tools, athenahealthenablesemployees to find a balance that feels fulfilling and productive for each individual situation. In addition to our traditional benefits and perks, we sponsor events throughout the year, including book clubs, external speakers, and hackathons. We provide athenistas with a company culture based on learning, the support of an engaged team, and an inclusive environment where all employees are valued.

Learn more about our culture and benefits here

athenahealth.com/careers https://www.athenahealth.com/careers/equal-opportunity

United by our mission

United by our mission and driven by our entrepreneurial spirit, our work at athenahealth is collaborative, transformative, and above all, it’s meaningful.