AI/ML Production Engineer II

CarMax Business Services; Richmond (VA); On-site; USD 89,000 - 133,000; Full time

Benefits offered by this job

Bonus eligibility

Equity

Job summary

CarMax is seeking an Engineer II in ML & AI Engineering to build and operate scalable machine learning capabilities across the organization. You will partner with Data Scientists to productionize models and develop reliable inference services, with a focus on testing, monitoring, and operational excellence.

This role emphasizes latency, throughput, cost considerations, and collaboration with engineering and product teams to deliver mission-critical capabilities powering CarMax’s iconic customer

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, or related technical field, or equivalent practical experience.
• 2+ years of professional software/AI engineering experience, building and supporting production apps in enterprise environments.
• Proficiency in Python, Java, or C# and ML frameworks such as PyTorch or TensorFlow.
• Experience with distributed databases (e.g., DynamoDB, Cosmos DB), caching, vector DBs for high-throughput, low-latency workloads.
• Excellent communication and collaboration skills on agile teams.

Responsibilities

• Build and maintain production ML capabilities including feature engineering, training, evaluation, deployment, and inference.
• Design agentic AI systems with orchestration, memory, and evaluation observability for production reliability.
• Own monitoring and incident response for model performance and data drift across production ML systems.
• Collaborate with Data Scientists to translate experiments into production-grade code.
• Turn ML models into mission-critical capabilities supporting CarMax's customer experience.
• Drive innovation and improvements in Data Science and ML domains.

Skills

Python

Java

C#

PyTorch

TensorFlow

Communication skills

Agile team collaboration

Education

Bachelor's degree in CS/CE or related field

Tools

DynamoDB

Cosmos DB

Job description

CarMax is seeking an Engineer II in ML & AI Engineering to build and operate scalable machine learning capabilities across the organization. You will partner with Data Scientists to productionize models and develop reliable inference services, with a focus on testing, monitoring, and operational excellence.

This role emphasizes latency, throughput, cost considerations, and collaboration with engineering and product teams to deliver mission-critical capabilities powering CarMax’s iconic customer