Sr. Engineer, AI & ML

CarMax; Midtown (NC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Bonus eligibility

Equity

Job summary

CarMax is seeking a Sr. Engineer, AI & ML to design and implement Generative AI solutions for omni-channel customer experiences. You will work with LLMs, semantic search, and AI orchestration to deliver scalable applications.

The role is based at CarMax Midtown office, Richmond VA or CarMax Technology Hub, Plano TX with a hybrid work arrangement; associates based in Richmond work onsite full-time, those in Plano two days per week. Sponsorship is not provided for this role.

Qualifications

• Bachelor’s degree in CS, Engineering, or related field (or equivalent experience).
• 5+ years of AI/ML, cloud computing, or systems engineering.
• Proficient in Python and scripting (e.g., shell).
• Hands-on with Azure OpenAI Service and Azure AI Search.
• Expertise in LLMs, semantic search, and AI orchestration.
• Experience with DevOps, CI/CD, and testing frameworks.
• Strong communication and cross-team influencing ability.

Responsibilities

• Design, develop, and deploy Generative AI models incl. LLMs and semantic search.
• Address implementation challenges with creative, sound solutions.
• Build integrated monitoring to validate AI performance.
• Mentor engineers on GenAI development and deployment.
• Review code for quality and clean coding standards.
• Collaborate on prompt engineering, testing, evaluation using tools like PromptFlow.
• Drive continuous AI architecture improvement via stakeholder feedback.

Skills

AI/ML experience

Python

Azure OpenAI Service

Azure AI Search

CI/CD

Communication

Education

Bachelor’s degree in CS/Engineering or related field

Master’s degree (preferred)

Tools

Azure OpenAI Service

Semantic Kernel

PromptFlow

Job description

8116 - Midtown Office - 2220 W. Broad Street, Richmond, Virginia, 23220

CarMax, the way your career should be!

Position Overview

As a Sr. Engineer, AI & ML, you will play a pivotal role in designing and implementing advanced Generative AI solutions that elevate CarMax’s omni-channel customer experience. You will leverage expertise in large language models (LLMs), semantic search frameworks, and AI orchestration to deliver innovative, scalable applications. Your work will directly influence CarMax’s technology evolution, ensuring secure, high-performing AI systems that drive business impact.

Why CarMax?

At CarMax, we are the nation’s largest retailer of used cars with stores from coast to coast, and we are still growing. We’re rethinking the way people buy cars - and it’s our associates that help us do just that. We believe work should feel meaningful and rewarding, with opportunities to make an impact every day. This is where innovation meets passion - be inspired and supported to take us to the future.

Team Overview

You’ll join CarMax’s GenAI team, collaborating with engineers, product leaders, and stakeholders to build next-generation AI capabilities. This team focuses on creating enterprise-grade AI solutions that enhance customer interactions and streamline business processes through cutting-edge machine learning technologies.

Role Responsibilities

• Design, develop, and deploy Generative AI models, including LLMs and semantic search frameworks, for customer-facing solutions.
• Identify and address implementation challenges, providing creative, technically sound solutions.
• Build integrated monitoring systems to validate AI performance and ensure architecture integrity.
• Mentor engineers on best practices for Generative AI development and deployment.
• Review code for quality and adherence to clean coding standards.
• Collaborate on prompt engineering, testing, and evaluation using tools such as PromptFlow.
• Drive continuous improvement in AI architecture through innovation and stakeholder feedback.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 5+ years of experience in AI/ML, cloud computing, or systems engineering.
• Advanced proficiency in Python and scripting languages (e.g., shell scripts).
• Hands‑on experience with Azure OpenAI Service and Azure AI Search.
• Expertise in LLMs, semantic search frameworks, and AI orchestration layers (e.g., Semantic Kernel).
• Experience with DevOps practices, CI/CD pipelines, and testing frameworks.
• Strong communication skills and ability to influence technical vision across teams.

Preferred Qualifications

• Master’s degree in Computer Science, Engineering, or related field.
• Experience integrating CI/CD pipelines for prompt engineering with feedback loops.
• Knowledge of advanced Generative AI development tools and frameworks for enterprise-scale applications.

Work Location and Arrangement

This role will be based out of the CarMax Midtown office, Richmond VA or CarMax Technology Hub, Plano TX and have a Hybrid work arrangement.

• Associates based in Richmond work onsite 5 days per week.

• Associates based in Plano work onsite 2 days per week.

Work Authorization

Applicants must be currently authorized to work in the United States on a full-time basis. Sponsorship will not be considered for this specific role.

About CarMax

At CarMax, we revolutionized the used car buying experience over 30 years ago by introducing transparency and integrity into the process. Our commitment to customer experience, innovation, and community has made us the nation’s largest used car retailer. With over 250 store locations and over 30,000 associates, we are proud to have been recognized as one of the Fortune 100 Best Companies to Work For® and are committed to helping our communities thrive.

As an associate, you are part of an innovative movement to empower the modern customer and drive progress. Your work fuels change-sparking ideas, overcoming challenges, and shaping what’s next. Join us in creating a better future- for our company, our customers, and the communities we call home.

CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law.

The annual salary for this position is:

$120,000.00 - $180,000.00

May be eligible for bonus and equity.

Benefits

Except as otherwise required by state law, CarMax Associates are entitled to the following paid sick, vacation, and holiday time.

Associates that are considered full-time hourly or commission/incentive eligible:

• To earn up to 48 hours of sick time per year accrued on a per pay period basis and between 80 hours and 200 hours per year of vacation time after a 90 day waiting period depending on years of continuous service with the Company.
• For 8 hours of pay for each of a total of 6 paid scheduled holidays per year plus 1 floating holiday. If such an Associate does work on a scheduled holiday due to business need, they are eligible for Holiday Premium Pay.

Associates considered full-time salaried are entitled to paid time away with no specified limit as needed for sick, vacation, bereavement, jury duty, holidays, floating holiday, etc. subject to manager approval.

For more details about benefits, please visit our CarMax Benefits website.

Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application.