Senior AI/ML Engineer: Generative AI & LLM Solutions

CarMax; Midtown (NC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Bonus eligibility

Equity

Job summary

CarMax is seeking a Sr. Engineer, AI & ML to design and implement Generative AI solutions for omni-channel customer experiences. You will work with LLMs, semantic search, and AI orchestration to deliver scalable applications.

The role is based at CarMax Midtown office, Richmond VA or CarMax Technology Hub, Plano TX with a hybrid work arrangement; associates based in Richmond work onsite full-time, those in Plano two days per week. Sponsorship is not provided for this role.

Qualifications

• Bachelor’s degree in CS, Engineering, or related field (or equivalent experience).
• 5+ years of AI/ML, cloud computing, or systems engineering.
• Proficient in Python and scripting (e.g., shell).
• Hands-on with Azure OpenAI Service and Azure AI Search.
• Expertise in LLMs, semantic search, and AI orchestration.
• Experience with DevOps, CI/CD, and testing frameworks.
• Strong communication and cross-team influencing ability.

Responsibilities

• Design, develop, and deploy Generative AI models incl. LLMs and semantic search.
• Address implementation challenges with creative, sound solutions.
• Build integrated monitoring to validate AI performance.
• Mentor engineers on GenAI development and deployment.
• Review code for quality and clean coding standards.
• Collaborate on prompt engineering, testing, evaluation using tools like PromptFlow.
• Drive continuous AI architecture improvement via stakeholder feedback.

Skills

AI/ML experience

Python

Azure OpenAI Service

Azure AI Search

CI/CD

Communication

Education

Bachelor’s degree in CS/Engineering or related field

Master’s degree (preferred)

Tools

Azure OpenAI Service

Semantic Kernel

PromptFlow

Job description

CarMax is seeking a Sr. Engineer, AI & ML to design and implement Generative AI solutions for omni-channel customer experiences. You will work with LLMs, semantic search, and AI orchestration to deliver scalable applications.

The role is based at CarMax Midtown office, Richmond VA or CarMax Technology Hub, Plano TX with a hybrid work arrangement; associates based in Richmond work onsite full-time, those in Plano two days per week. Sponsorship is not provided for this role.