VP, Conversational AI Design & Strategy

Morgan Stanley; Town/Village of Harrison (NY); On-site; USD 110,000 - 140,000; Full time

Job summary

Morgan Stanley in New York City seeks a Conversational AI Specialist (VP) to design enterprise-grade conversational experiences, develop automation tools, and refine generative AI models for reliable outputs. You will collaborate with business teams, technology partners, and AI governance teams to accelerate adoption.

The role emphasizes prompt engineering, testing methodologies, risk management, and performance monitoring, with governance and quality ownership across client and employee

Qualifications

• Experience with conversational AI solutioning / development / experimentation.
• Experience with prompt engineering for commercial or open-source LLMs (e.g., GPT, Claude, Gemini, LLAMA).
• Experience with AI evaluation techniques (F1, RAGAS, human feedback analysis).
• Strong understanding of AI concepts and technologies.
• Excellent communication, interpersonal and leadership skills.
• Proven experience in program or project management.
• Ability to manage multiple projects in a fast-paced environment.
• Strong analytical and problem-solving abilities.

Responsibilities

• Develop and maintain differentiated conversational experiences for employee and client virtual assistants.
• Refine context-aware prompts for diverse use cases and ensure scalable integration with infrastructure.
• Create data-driven testing/evaluation methodologies for AI responses and manage human evaluations.
• Identify and troubleshoot model output issues and recommend improvements.
• Identify risks, monitor performance, and implement mitigation actions.
• Maintain effective communication with internal stakeholders and vendor partners.
• Collaborate with cross-functional teams to drive initiatives and adoption.
• Track KPIs and propose improvements based on results.

Skills

Conversational AI

Prompt engineering

Model evaluation

AI concepts

Communication & leadership

Program/project management

Multi-tasking in fast-paced env

Analytical thinking

Job description

Morgan Stanley in New York City seeks a Conversational AI Specialist (VP) to design enterprise-grade conversational experiences, develop automation tools, and refine generative AI models for reliable outputs. You will collaborate with business teams, technology partners, and AI governance teams to accelerate adoption.

The role emphasizes prompt engineering, testing methodologies, risk management, and performance monitoring, with governance and quality ownership across client and employee