AI/LLM Product Director - Executive Director

Testing Site - JPMC; Palo Alto (CA); On-site; USD 200,000 - 260,000; Full time

Job summary

Testing Site - JPMC is seeking a Product Director to lead AI/LLM initiatives for an enterprise search platform, guiding architecture, roadmap, and delivery across product, data science, and engineering teams. You will drive scalable, secure solutions, establish KPIs, and mentor the team while partnering with business leaders to translate innovation into client value.

Responsibilities include integrating semantic search, SFT, RLHF, RAG, and agents, ensuring regulatory compliance, and delivering a

Qualifications

• 8+ years of building and launching AI/LLM products.
• Strong collaboration skills, with the ability to positively influence technology teams and stakeholders.
• Knowledge of AI/LLM and data product lifecycle, including discovery, data processing, model development, model deployment, and model monitoring.
• Familiarity with ElasticSearch, SFT, Reinforcement Learning with Human Feedback (RLHF), RAG, and Agents.
• Knowledge of LLM frameworks such as LangChain, LangGraph, and OpenLLM.
• Understanding of operationalizing AI products responsibly through MLOps pipeline.
• Basic expertise in Cloud computing and architecture (e.g., AWS).

Responsibilities

• Oversees the product roadmap, vision, development, execution, risk management, and business growth targets for both conventional and LLM-based generative search.
• Leverage a wide range of cutting-edge technologies such as Semantic Search, Personalized Search, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), Retrieval-Augmented Generation (RAG), and Agents to enhance user experiences.
• Incorporate established search methodologies and technologies, including Boolean Search, Keyword Search, Faceted Search, and Full-Text Search, to improve overall search capabilities and user experience.
• Partner with internal stakeholders, including business leaders, data scientists, engineers, and designers, to align requirements, define product features, and ensure successful product delivery.
• Oversee the integration and release of Search and LLM technologies into GB products and services. Ensure that solutions are scalable, secure, and compliant with regulatory requirements.
• Help define and track key performance indicators (KPIs) to measure the success of Search and LLM products. Use data-driven insights to support informed decisions and drive continuous improvement.
• Coaches and mentors the product team on best practices, such as solution generation, market research, storyboarding, mind-mapping, prototyping methods, product adoption strategies, and product delivery, enabling them to effectively deliver on objectives

Skills

AI/LLM leadership

Cross-functional leadership

SDLC knowledge

MLOps pipeline

Cloud basics (AWS)

Tools

ElasticSearch

LangChain

OpenLLM

Job description

You enjoy contributing to the future of product innovation, supporting value creation for customers, assisting in successful launches, and meeting expectations. Join our dynamic team and make a meaningful impact by supporting the delivery of high-quality products that resonate with clients.

As a Product Director leading AI / LLM initiatives, you will assist in delivering a business-friendly, best-in-class enterprise Search capability incorporating the latest technologies (including AI/LLM) and applying best practices. You are expected to support the design and architecture of the solutions while focusing on various stages of the Software Development Lifecycle (SDLC). As a leader on the team, you leverage your advanced capabilities to challenge traditional approaches, remove barriers to success, and foster a culture of continuous innovation that helps inspire cross-functional teams create groundbreaking solutions that address customer needs.

Job Responsibilities

• Oversees the product roadmap, vision, development, execution, risk management, and business growth targets for both conventional and LLM-based generative search.
• Leverage a wide range of cutting-edge technologies such as Semantic Search, Personalized Search, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), Retrieval-Augmented Generation (RAG), and Agents to enhance user experiences.
• Incorporate established search methodologies and technologies, including Boolean Search, Keyword Search, Faceted Search, and Full-Text Search, to improve overall search capabilities and user experience.
• Partner with internal stakeholders, including business leaders, data scientists, engineers, and designers, to align requirements, define product features, and ensure successful product delivery.
• Oversee the integration and release of Search and LLM technologies into GB products and services. Ensure that solutions are scalable, secure, and compliant with regulatory requirements.
• Help define and track key performance indicators (KPIs) to measure the success of Search and LLM products. Use data-driven insights to support informed decisions and drive continuous improvement.
• Coaches and mentors the product team on best practices, such as solution generation, market research, storyboarding, mind-mapping, prototyping methods, product adoption strategies, and product delivery, enabling them to effectively deliver on objectives

Required Qualifications, Capabilities, and Skills

• 8+ years of building and launching AI / LLM products.
• Strong collaboration skills, with the ability to positively influence technology teams and stakeholders.
• Knowledge of AI/LLM and data product lifecycle, including discovery, data processing, model development, model deployment, and model monitoring.
• Familiarity with ElasticSearch, Supervised Fine-Tuning (SFT), Reinforcement Learning with Human Feedback (RLHF), RAG, and Agents.
• Knowledge of LLM frameworks such as LangChain, LangGraph, and OpenLLM.
• Understanding of operationalizing AI products responsibly through MLOps pipeline.
• Basic expertise in Cloud computing and architecture (e.g., AWS).

Preferred Qualifications, Capabilities, and Skills

• Search Product experience preferred, but not required.Recognized thought leader in this space.
• Experience in Financial Services or other highly regulated industries.