AI/ML Engineer II — Production ML at Scale (Equity Eligible)

CarMax; United States; Hybrid; USD 89,000 - 133,000; Full time

Benefits offered by this job

Paid sick time

Vacation time

Holiday time

Job summary

CarMax is seeking an Engineer II, ML & AI Engineering to build and operate scalable ML/AI capabilities across the organization. You will partner with Data Scientists to productionize models and develop reliable inference services, focusing on testing, monitoring, and scalability to support CarMax's iconic customer experience.

You will design tool-use-enabled AI systems and own the operational health of production ML systems, ensuring low latency and high availability in enterprise environments.

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.
• 2 years of professional experience in software engineering, systems engineering, machine learning engineering, or AI engineering, including experience building, deploying, and supporting production applications in an enterprise environment.
• Proficiency in a programming language such as Python, Java, or C#, and hands-on experience with ML frameworks such as PyTorch or TensorFlow.
• Working knowledge of distributed databases (e.g., DynamoDB, Cosmos DB), caching systems, and vector databases, with experience applying them to high-throughput, low-latency production workloads.
• Excellent communication skills, with the ability to adapt messaging to technical and non-technical audiences.
• Experience on a fast-paced, highly collaborative agile team within a product-oriented organization.

Responsibilities

• Build and maintain production machine learning capabilities spanning feature engineering, training, evaluation, deployment, and model inference supporting initiatives across the organization, with attention to latency, throughput, and cost.
• Design and build agentic AI systems, including tool use, orchestration, memory, and the evaluation harnesses and observability needed to run them reliably in production.
• Own the operational health of production ML and agentic systems: monitoring and alerting for model performance, data drift, and prediction quality, plus on-call incident response end to end and the follow-through that prevents repeat failures
• Collaborate with Data Scientists to translate experimental work into tested, maintainable, production-grade code.
• Partner with engineering and product teams to turn machine learning models into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience
• Demonstrates a passion for Data Science and Machine Learning, continuously driving innovation and improvement in these domains.

Skills

Python

Java

C#

PyTorch

TensorFlow

Cloud engineering

Communication

Agile

Education

Bachelor's degree in Computer Science/Engineering or related field

Tools

DynamoDB

Cosmos DB

Caching systems

Vector databases

MLflow

Azure ML

SageMaker

Kubeflow

Job description

CarMax is seeking an Engineer II, ML & AI Engineering to build and operate scalable ML/AI capabilities across the organization. You will partner with Data Scientists to productionize models and develop reliable inference services, focusing on testing, monitoring, and scalability to support CarMax's iconic customer experience.

You will design tool-use-enabled AI systems and own the operational health of production ML systems, ensuring low latency and high availability in enterprise environments.