Manager Data Science, Generative AI - Hybrid

CarMax; Dallas (TX); Hybrid; USD 120,000 - 160,000; Full time

Job summary

CarMax is seeking a Data Science Manager for their Generative AI team to drive innovation in AI applications across the company. This role involves designing evaluation methods, researching advanced uses of LLMs, and ensuring effective implementation of AI technologies to enhance customer experiences. Candidates should possess an advanced degree in a relevant field and 3+ years of relevant experience, especially in Python development and data science.

Qualifications

• 3+ years of experience in AI, data science, and machine learning.
• Strong analytical curiosity and problem-solving skills.
• Ability to communicate technical topics effectively.

Responsibilities

• Research and implement generative AI applications for business value.
• Design evaluation and performance methods for AI systems.
• Stay updated on industry trends and recommend investment directions.

Skills

Python development

Data mining

Machine learning

Statistical modeling

Analytical thinking

Project management

Education

Master’s/Ph.D. in quantitative discipline

Job description

8901 - Corp Office West Crk - 12800 Tuckahoe Creek Parkway, Richmond, Virginia, 23238

CarMax, the way your career should be!

Data Science Manager - Generative AI

About this Job

As a Data Science Manager on the Generative AI team you'll have the opportunity to shape the way that CarMax uses generative AI to create value across the company. The pace of innovation in the AI space today means that keeping up with the industry innovation and ensuring it can be applied effectively across the enterprise is a complex and critical role for us.

In this role you will:

• Research, design, and implement evaluation methods for generative AI applications. Our primary focus today is on language understanding and generation, primarily with AI chatbot assistants but also with summarization, ticket routing, and other use cases. This includes both automated evaluation methods (LLM as judge) as well as systematic approaches to manual review and monitoring.

• Research, design, and implementation of search methods including vector databases and semantic search algorithms , and associated performance evaluation methods. Our primary focus in this space today is powering a knowledge base search system that powers a RAG pipeline for our AI assistant chatbots.

• Research methods for the advanced use of LLMs, e.g. fine tuning, custom training of open source models, and evaluation/comparison of available foundation and open source models. While we are not heavily focusing our efforts in this space today, it's important that we keep up with industry trends and maintain a perspective on how CarMax can make the best use of current technology.

• Keep up to date on industry trends in technology products and third party solutions, provide a perspective on where CarMax should consider investing, and occasionally conduct technology evaluations.

Qualifications and Requirements:

• Advanced Degree (Master’s/Ph.D.) in quantitative discipline (AI, Machine Learning, Statistics, Math, Data Science, Computer Science) is preferred

• 3+ years of experience in the following areas:

• Python development

• Data mining, machine learning, statistical modeling tools and underlying algorithms

• Data Lake and cloud computing fundamentals

• Strong analytical curiosity and passion for applying advanced modeling techniques in problem solving

• Sound analytical thinker with a proven track record of providing actionable insights and clear strategic direction

• Ability to convey complex, technical subject matter in a clear and straightforward manner; demonstrated ability to effectively communicate through written and oral presentations with all levels of the organization

• Solid project management skills with the ability to juggle multiple priorities simultaneously in a fast-paced environment

Preferred Experience

• Research and development experience with AI, data science or other scientific / technology methods, exploring the practical application of emerging methods

• Applied NLP to analyze and work with text data at scale

• Experience working with LLM's and the application of generative AI to drive practical business value

• Python development and cloud engineering, specifically working a production quality code base to test new features and contribute usable code

• Chatbot design, development and evaluation are a plus

Work Location and Arrangement: This role will be based out of the either the Richmond, VA Home Office, the Dallas, TX Technology Hub or the Atlanta, GA CarMax Auto Finance Office and has a Hybrid work arrangementin office 2 days a week.

Work Authorization: A pplicants must be currently authorized to work in the United States on a full-time basis. Sponsorship will not be considered for this specific role.

About CarMax

CarMax disrupted the auto industry by delivering the honest, transparent and high-integrity experience customers want and deserve. This innovative thinkingaround the way cars are bought and soldhas helped us become the nation’s largest retailer of used cars, with over 200 locations nationwide.

Ouramazing team of more than 25,000 associates work together to deliver iconic customer experiences.Along the way,we help every associate grow their career and achieve their best, at work and in their community. We are recognized for our commitment to training and diversity and areone of the FORTUNE 100 Best Companies to Work For.

CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law.

Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application.