Sr. Engineer, AI & ML

CarMax Business Services; Richmond (VA); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work arrangement

Bonus potential

Equity eligibility

Job summary

CarMax in Richmond, Virginia seeks a Sr. Engineer, AI & ML to design and deploy Generative AI solutions that elevate CarMax’s omni-channel customer experience.

You will leverage LLMs, semantic search, and AI orchestration to deliver scalable applications with secure, high-performing systems. You’ll join the GenAI team, collaborating with engineers, product leaders, and stakeholders to build enterprise-grade AI capabilities for customer interactions and business processes.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 4+ years of experience in AI/ML, cloud computing, or systems engineering.
• Advanced proficiency in Python and scripting languages.
• Hands-on experience with Azure OpenAI Service and Azure AI Search.
• Expertise in LLMs, semantic search frameworks, and AI orchestration.
• Experience with DevOps practices, CI/CD pipelines, and testing frameworks.
• Strong communication and ability to influence technical vision across teams.

Responsibilities

• Design, develop, and deploy Generative AI models, including LLMs and semantic search frameworks, for customer-facing solutions.
• Identify and address implementation challenges, providing creative, technically sound solutions.
• Build integrated monitoring systems to validate AI performance and ensure architecture integrity.
• Mentor engineers on best practices for Generative AI development and deployment.
• Review code for quality and adherence to clean coding standards.
• Collaborate on prompt engineering, testing, and evaluation using tools such as PromptFlow.
• Drive continuous improvement in AI architecture through innovation and stakeholder feedback.

Skills

LLMs & semantic search

AI/ML design

Prompt engineering

CI/CD & DevOps

Cross-team communication

Mentoring

Education

Bachelor's degree in CS/Engineering

Master's degree (preferred)

Tools

Azure OpenAI Service

Azure AI Search

Semantic Kernel

PromptFlow

Job description

8116 - Midtown Office - 2220 W. Broad Street, Richmond, Virginia, 23220

CarMax, the way your career should be!

Position Overview

As a Sr. Engineer, AI & ML, you will play a pivotal role in designing and implementing advanced Generative AI solutions that elevate CarMax’s omni-channel customer experience. You will leverage expertise in large language models (LLMs), semantic search frameworks, and AI orchestration to deliver innovative, scalable applications. Your work will directly influence CarMax’s technology evolution, ensuring secure, high-performing AI systems that drive business impact.

Why CarMax?

At CarMax, we are the nation’s largest retailer of used cars with stores from coast to coast, and we are still growing. We’re rethinking the way people buy cars – and it’s our associates that help us do just that. We believe work should feel meaningful and rewarding, with opportunities to make an impact every day. This is where innovation meets passion – be inspired and supported to take us to the future.

Team Overview

You’ll join CarMax’s GenAI team, collaborating with engineers, product leaders, and stakeholders to build next-generation AI capabilities. This team focuses on creating enterprise-grade AI solutions that enhance customer interactions and streamline business processes through cutting-edge machine learning technologies.

Role Responsibilities

• Design, develop, and deploy Generative AI models, including LLMs and semantic search frameworks, for customer-facing solutions.
• Identify and address implementation challenges, providing creative, technically sound solutions.
• Build integrated monitoring systems to validate AI performance and ensure architecture integrity.
• Mentor engineers on best practices for Generative AI development and deployment.
• Review code for quality and adherence to clean coding standards.
• Collaborate on prompt engineering, testing, and evaluation using tools such as PromptFlow.
• Drive continuous improvement in AI architecture through innovation and stakeholder feedback.

Required Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 4+ years of experience in AI/ML, cloud computing, or systems engineering.
• Advanced proficiency in Python and scripting languages (e.g., shell scripts).
• Hands-on experience with Azure OpenAI Service and Azure AI Search.
• Expertise in LLMs, semantic search frameworks, and AI orchestration layers (e.g., Semantic Kernel).
• Experience with DevOps practices, CI/CD pipelines, and testing frameworks.
• Strong communication skills and ability to influence technical vision across teams.

Preferred Qualifications

• Master’s degree in Computer Science, Engineering, or related field.
• Experience integrating CI/CD pipelines for prompt engineering with feedback loops.
• Knowledge of advanced Generative AI development tools and frameworks for enterprise-scale applications.

Work Location and Arrangement

This role will be based out of the CarMax Midtown office, Richmond VA or CarMax Technology Hub, Plano TX and have a Hybrid work arrangement.

• Associatesbased in Richmondworkonsite5 days per week.

• Associates based in Planowork onsite2 days per week.

Work Authorization: Applicants must be currently authorized to work in the United States on a full-time basis. Sponsorship will not be considered for this specific role.

About CarMax

At CarMax, we revolutionized the used car buying experience over 30 years ago by introducing transparency and integrity into the process. Our commitment to customer experience, innovation, and community has made us the nation’s largest used car retailer. With over 250 store locations and over 30,000 associates, we are proud to have been recognized as one of the Fortune 100 Best Companies to Work For® and are committed to helping our communities thrive.

As an associate, you are part of an innovative movement to empower the modern customer and drive progress. Your work fuels change—sparking ideas, overcoming challenges, and shaping what’s next. Join us in creating a better future– for our company, our customers, and the communities we call home.

CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law.

The annual salary for this position is:

$120,000.00 - $180,000.00

May be eligible for bonus and equity.

Benefits

Except as otherwise required by state law, CarMax Associates are entitled to the following paid sick, vacation, and holiday time.

Associates that are considered full-time hourly or commission/incentive eligible:

• To earn up to 48 hours of sick time per year accrued on a per pay period basis and between 80 hours and 200 hours per year of vacation time after a 90 day waiting period depending on years of continuous service with the Company.
• For 8 hours of pay for each of a total of 6 paid scheduled holidays per year plus 1 floating holiday. If such an Associate does work on a scheduled holiday due to business need, they are eligible for Holiday Premium Pay.

Associates considered full-time salaried are entitled to paid time away with no specified limit as needed for sick, vacation, bereavement, jury duty, holidays, floating holiday, etc. subject to manager approval.

For more details about benefits, please visit our CarMax Benefits website.

Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application