Senior AI & ML Engineer — Generative AI & LLMs

CarMax Business Services; United States; Hybrid; USD 120,000 - 180,000; Full time

Job summary

CarMax is seeking a Senior Engineer, AI & ML to design and implement Generative AI solutions for omni‑channel experiences. You will work with LLMs, semantic search, and AI orchestration to deliver enterprise‑grade, secure AI systems that drive business impact.

You will mentor engineers, collaborate with product teams, and ensure high‑performing architectures while contributing to code quality and testing practices.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience).
• 4+ years of experience in AI/ML, cloud computing, or systems engineering.
• Advanced proficiency in Python and scripting languages (e.g., shell scripts).
• Hands‑on experience with Azure OpenAI Service and Azure AI Search.
• Expertise in LLMs, semantic search frameworks, and AI orchestration layers (e.g., Semantic Kernel).
• Experience with DevOps practices, CI/CD pipelines, and testing frameworks.
• Strong communication skills and ability to influence technical vision across teams.

Responsibilities

• Design, develop, and deploy Generative AI models, including LLMs and semantic search frameworks, for customer‑facing solutions.
• Identify and address implementation challenges, providing creative, technically sound solutions.
• Build integrated monitoring systems to validate AI performance and ensure architecture integrity.
• Mentor engineers on best practices for Generative AI development and deployment.
• Review code for quality and adherence to clean coding standards.
• Collaborate on prompt engineering, testing, and evaluation using tools such as PromptFlow.
• Drive continuous improvement in AI architecture through innovation and stakeholder feedback.

Skills

Python

LLMs

Semantic search

AI orchestration

Prompt engineering

DevOps

CI/CD

Testing frameworks

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

Azure OpenAI Service

Azure AI Search

Job description

CarMax is seeking a Senior Engineer, AI & ML to design and implement Generative AI solutions for omni‑channel experiences. You will work with LLMs, semantic search, and AI orchestration to deliver enterprise‑grade, secure AI systems that drive business impact.

You will mentor engineers, collaborate with product teams, and ensure high‑performing architectures while contributing to code quality and testing practices.