VP, Conversational AI & Enterprise Experience

Morgan-Stanley; Town of Islip (NY); On-site; USD 110,000 - 140,000; Full time

Job summary

Morgan Stanley in New York City seeks a skilled Conversational AI Specialist to design and refine enterprise-level AI chat solutions, build smart automation, and evaluate generative models for high-quality outputs. You will coordinate with business, tech, and vendor teams to accelerate AI adoption.

The role emphasizes prompt engineering, testing, and risk-aware delivery in a fast-paced environment with cross-functional collaboration across firm-wide AI initiatives.

Qualifications

• Experience with Conversational AI solutioning / product development / experimentation or Innovation.
• Experience with prompt engineering for using Commercial or Open Source LLMs.
• Experience with conversational AI evaluation techniques and human feedback analysis.
• Strong understanding of AI concepts and technologies.
• Excellent communication, interpersonal and leadership skills.
• Proven experience in program or project management; able to manage multiple projects.

Responsibilities

• Develop and maintain differentiated conversational experiences for employee and client virtual assistant experiences.
• Develop and refine context-aware prompts for various use cases and intents.
• Create data driven testing and evaluation methodologies for LLM outputs.
• Identify and troubleshoot issues in LLM model outputs and propose improvements.
• Monitor risks and manage stakeholder expectations; report progress with KPIs.

Skills

Conversational AI

Prompt engineering

Evaluation techniques

AI concepts

Communication skills

Program/Project management

Tools

GPT family

Claude

Gemini

LLAMA

Job description

Morgan Stanley in New York City seeks a skilled Conversational AI Specialist to design and refine enterprise-level AI chat solutions, build smart automation, and evaluate generative models for high-quality outputs. You will coordinate with business, tech, and vendor teams to accelerate AI adoption.

The role emphasizes prompt engineering, testing, and risk-aware delivery in a fast-paced environment with cross-functional collaboration across firm-wide AI initiatives.