ML & AI Engineer II — Production AI Systems

CarMax Business Services; Plano (TX); On-site; USD 89,000 - 133,000; Full time

Job summary

CarMax seeks an Engineer II, ML & AI Engineering to build and operate scalable machine learning and AI capabilities across the organization, partnering with Data Scientists to productionize models and develop reliable inference services with a focus on testing, monitoring, scalability, and operational excellence.

This role emphasizes turning research into production-grade software, owning the health of ML systems, collaborating with engineering and product teams, and delivering high-visibility

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.
• 2+ years of professional experience in software engineering, systems engineering, machine learning engineering, or AI engineering, including experience building, deploying, and supporting production applications in an enterprise environment.
• Proficiency in a programming language such as Python, Java, or C#, and hands-on experience with ML frameworks such as PyTorch or TensorFlow
• Working knowledge of distributed databases (e.g., DynamoDB, Cosmos DB), caching systems, and vector databases, with experience applying them to high-throughput, low-latency production workloads
• Excellent communication skills, with the ability to adapt messaging to technical and non-technical audiences
• Experience on a fast-paced, highly collaborative agile team within a product-oriented organization

Responsibilities

• Build and maintain production machine learning capabilities spanning feature engineering, training, evaluation, deployment, and model inference supporting initiatives across the organization, with attention to latency, throughput, and cost
• Design and build agentic AI systems, including tool use, orchestration, memory, and the evaluation harnesses and observability needed to run them reliably in production.
• Own the operational health of production ML and agentic systems: monitoring and alerting for model performance, data drift, and prediction quality, plus on-call incident response end to end and the follow-through that prevents repeat failures
• Collaborate with Data Scientists to translate experimental work into tested, maintainable, production-grade code.
• Partner with engineering and product teams to turn machine learning models into mission-critical, high-visibility capabilities that support CarMax's iconic customer experience
• Demonstrates a passion for Data Science and Machine Learning, continuously driving innovation and improvement in these domains.

Skills

Python

Java

C#

PyTorch

TensorFlow

Distributed databases

Communication

Agile

Education

Bachelor's degree in Computer Science/Engineering or related field

Tools

DynamoDB

Cosmos DB

Caching systems

Vector databases

MLflow

Azure ML

SageMaker

Kubeflow

Job description

CarMax seeks an Engineer II, ML & AI Engineering to build and operate scalable machine learning and AI capabilities across the organization, partnering with Data Scientists to productionize models and develop reliable inference services with a focus on testing, monitoring, scalability, and operational excellence.

This role emphasizes turning research into production-grade software, owning the health of ML systems, collaborating with engineering and product teams, and delivering high-visibility