Engineer II, AI/ML

CarMax; United States; Hybrid; USD 89,000 - 133,000; Full time

Benefits offered by this job

Paid sick time

Vacation time

Holiday time

Job summary

CarMax is seeking an Engineer II, ML & AI Engineering to build and operate scalable ML/AI capabilities across the organization. You will partner with Data Scientists to productionize models and develop reliable inference services, focusing on testing, monitoring, and scalability to support CarMax's iconic customer experience.

You will design tool-use-enabled AI systems and own the operational health of production ML systems, ensuring low latency and high availability in enterprise environments.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.
• 2 years of professional experience in software engineering, systems engineering, machine learning engineering, or AI engineering, including experience building, deploying, and supporting production applications in an enterprise environment.
• Proficiency in a programming language such as Python, Java, or C#, and hands-on experience with ML frameworks such as PyTorch or TensorFlow.
• Working knowledge of distributed databases (e.g., DynamoDB, Cosmos DB), caching systems, and vector databases, with experience applying them to high-throughput, low-latency production workloads.
• Excellent communication skills, with the ability to adapt messaging to technical and non-technical audiences.
• Experience on a fast-paced, highly collaborative agile team within a product-oriented organization.

Responsibilities

• Build and maintain production machine learning capabilities spanning feature engineering, training, evaluation, deployment, and model inference supporting initiatives across the organization, with attention to latency, throughput, and cost.
• Design and build agentic AI systems, including tool use, orchestration, memory, and the evaluation harnesses and observability needed to run them reliably in production.
• Own the operational health of production ML and agentic systems: monitoring and alerting for model performance, data drift, and prediction quality, plus on-call incident response end to end and the follow-through that prevents repeat failures
• Collaborate with Data Scientists to translate experimental work into tested, maintainable, production-grade code.
• Partner with engineering and product teams to turn machine learning models into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience
• Demonstrates a passion for Data Science and Machine Learning, continuously driving innovation and improvement in these domains.

Skills

Python

Java

C#

PyTorch

TensorFlow

Cloud engineering

Communication

Agile

Education

Bachelor's degree in Computer Science/Engineering or related field

Tools

DynamoDB

Cosmos DB

Caching systems

Vector databases

MLflow

Azure ML

SageMaker

Kubeflow

Job description

8116 - Midtown Office - 2220 W. Broad Street, Richmond, Virginia, 23220

CarMax, the way your career should be!

About This Job

The Engineer II, ML & AI Engineering role at CarMax is responsible for building and operating scalable machine learning and AI capabilities across the organization. You will partner closely with Data Scientists to productionize models and develop reliable inference services, with a focus on testing, monitoring, scalability, and operational excellence. This role plays a key part in delivering resilient, high-performing AI and ML solutions that power critical business and customer experiences.

We are looking for an engineer with a strong foundation in software and cloud engineering who is passionate about transforming machine learning and AI innovations into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience.

Essential Responsibilities

• Build and maintain production machine learning capabilities spanning feature engineering, training, evaluation, deployment, and model inference supporting initiatives across the organization, with attention to latency, throughput, and cost
• Design and build agentic AI systems, including tool use, orchestration, memory, and the evaluation harnesses and observability needed to run them reliably in production.
• Own the operational health of production ML and agentic systems: monitoring and alerting for model performance, data drift, and prediction quality, plus on-call incident response end to end and the follow-through that prevents repeat failures
• Collaborate with Data Scientists to translate experimental work into tested, maintainable, production-grade code.
• Partner with engineering and product teams to turn machine learning models into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience
• Demonstrates a passion for Data Science and Machine Learning, continuously driving innovation and improvement in these domains.

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience
• 2 years of professional experience in software engineering, systems engineering, machine learning engineering, or AI engineering, including experience building, deploying, and supporting production applications in an enterprise environment.
• Proficiency in a programming language such as Python, Java, or C#, and hands‑on experience with ML frameworks such as PyTorch or TensorFlow
• Working knowledge of distributed databases (e.g., DynamoDB, Cosmos DB), caching systems, and vector databases, with experience applying them to high‑throughput, low‑latency production workloads
• Excellent communication skills, with the ability to adapt messaging to technical and non‑technical audiences
• Experience on a fast‑paced, highly collaborative agile team within a product‑oriented organization

Preferred Qualifications

• Agentic development workflows: Comfortable using AI coding agents to plan, implement, test, and review software, along with sound judgment about where agent‑generated work requires human verification
• MLOps practices: experiment tracking, model registries, reproducible training, and CI/CD or automated retraining for ML (MLflow, Azure ML, SageMaker, Kubeflow, or equivalent)
• Experience with model serving platforms and real‑time inference (Azure ML endpoints, Databricks, SageMaker, or equivalent)
• Experience designing or operating microservices and distributed architectures (containers, Kubernetes, service‑to‑service APIs)

Work Location and Arrangement: This role can be based out of the CarMax Home Office in Richmond, VA and Associates will work onsite 4 days per week or this role can be based out of our Dallas Technology hub, Plano, TX and Associates will work onsite 2 days per week.

Work Authorization: Applicants must be currently authorized to work in the United States on a full‑time basis. Sponsorship will not be considered for this specific role.

About CarMax

CarMax disrupted the auto industry by delivering the honest, transparent and high‑integrity experience customers want and deserve. This innovative thinking around the way cars are bought and sold has helped us become the nation's largest retailer of used cars, with over 250 locations nationwide.

Our amazing team of more than 25,000 associates work together to deliver iconic customer experiences. Along the way, we help every associate grow their career and achieve their best, at work and in their community. We are recognized for our commitment to training and diversity and are one of the FORTUNE 100 Best Companies to Work For®.

Our Commitment To Diversity And Inclusion

CarMax is committed to bringing together people from different backgrounds and perspectives, providing employees with a safe, welcoming, and inclusive work environment.

CarMax is an equal opportunity employer, and all qualified candidates will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, genetic information, national origin, protected veteran status, disability status, or any other characteristic protected by law.

The Annual Salary For This Position Is

$88,800.00 - $133,200.00

May be eligible for bonus and equity.

Benefits

Except as otherwise required by state law, CarMax Associates are entitled to the following paid sick, vacation, and holiday time.

Associates That Are Considered Full‑time Hourly Or Commission/incentive Eligible

• To earn up to 48 hours of sick time per year accrued on a per pay period basis and between 80 hours and 200 hours per year of vacation time after a 90 day waiting period depending on years of continuous service with the Company.
• For 8 hours of pay for each of a total of 6 paid scheduled holidays per year plus 1 floating holiday. If such an Associate does work on a scheduled holiday due to business need, they are eligible for Holiday Premium Pay.

Associates considered full‑time salaried are entitled to paid time away with no specified limit as needed for sick, vacation, bereavement, jury duty, holidays, floating holiday, etc. subject to manager approval.

For more details about benefits, please visit our CarMax Benefits website.

Upon an applicant's request, CarMax will consider reasonable accommodation to complete the CarMax Job Application.