Lead Engineer, Applied AI & Build Standards

Best Buy Co.

Minneapolis (MN)

Hybrid

USD 121,000 - 217,000

Full time

13 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive pay
Employee discount
Retirement resources
Well-being support

Job summary

Best Buy is seeking a Staff Engineer on the Applied AI & Build Standards team to develop evaluation frameworks and release controls for safe, scalable AI agents. The role spans across the platform and aims to turn successful agent interactions into reusable capabilities and knowledge that accelerate future innovation.

The position is hybrid, with on-site work Monday–Thursday at the Richfield corporate office in Minnesota and Friday remote. Immigration sponsorship is available.

Qualifications

  • 5+ years of relevant experience with a Bachelor's degree OR equivalent relevant professional experience.
  • 3+ years of professional software development experience in Python.
  • 2+ years of experience building production data pipelines or search and retrieval systems, including data quality checks.
  • 1+ years of experience with formal or informal leadership.
  • Hands-on experience building evaluation frameworks for LLM-based applications or AI agents.
  • Daily, hands-on use of AI coding agents in how you write, test and review code.

Responsibilities

  • Own the roadmap and quality bar for agent evaluation across the platform, and influence architecture across teams.
  • Build eval datasets and harnesses from production agent traces, including trajectory evaluation for multi-step runs.
  • Wire evals into deployment pipelines as release gates, catching regressions as models and prompts change.
  • Calibrate LLM-as-judge scoring against human review, with annotation workflows that route the right traces to reviewers.
  • Run the learning loop: turn successful agent runs into reusable skills, with human-gated correction, replay and drift monitoring.
  • Own a permission-aware knowledge layer: source ingestion with provenance and freshness, and the context API that serves agents.
  • Use of Agentic AI as core development/coding tool.
  • 5 or more years of relevant experience with a Bachelor's degree OR equivalent relevant professional experience.
  • Daily, hands-on use of AI coding agents in how you write, test and review code.

Skills

LLM evaluation frameworks
Agent AI development
Python programming
Data pipelines
Leadership experience

Education

Bachelor's degree

Tools

Python

Job description

Best Buy is seeking a Staff Engineer on the Applied AI & Build Standards team to develop evaluation frameworks and release controls for safe, scalable AI agents. The role spans across the platform and aims to turn successful agent interactions into reusable capabilities and knowledge that accelerate future innovation.

The position is hybrid, with on-site work Monday–Thursday at the Richfield corporate office in Minnesota and Friday remote. Immigration sponsorship is available.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Platform Engineer — Hybrid On-site M-Th
Principal AI Platform Engineer — Hybrid On-site M-Th

Best Buy Co. • Minneapolis (MN)

Hybrid
USD 150,000 - 250,000
Staff Engineer: Cloud & AI Systems Leader
Staff Engineer: Cloud & AI Systems Leader

Best Buy Co. • Minneapolis (MN)

Hybrid
USD 130,000 - 210,000
Competitive pay
Employee discount
Financial savings and retirement
Cloud Engineer II: Supply Chain & Warehousing
Cloud Engineer II: Supply Chain & Warehousing

Best Buy Co. • Richfield (MN)

Hybrid
USD 100,000 - 150,000
Competitive pay
Employee discount
Well-being support
Sr. AI Software Engineer (Remote)
Sr. AI Software Engineer (Remote)

Inspira Financial • Oak Brook (IL)

Remote
USD 180,000 - 230,000
Sr. AI Software Engineer (Remote)
Sr. AI Software Engineer (Remote)

Inspira Financial Trust, LLC • Oak Brook (IL)

Remote
USD 130,000 - 190,000
AI-Driven Application Engineer
AI-Driven Application Engineer

The Home Depot • Atlanta (GA)

On-site
USD 120,000 - 160,000
Senior AI Platform Engineer: Build Safe, Scalable AI
Senior AI Platform Engineer: Build Safe, Scalable AI

Realtor.com • Jackson (TN)

On-site
USD 140,000 - 200,000
Health insurance
401(k) match
Tuition reimbursement
+1
Lead Full-Stack Engineer, AI Platform
Lead Full-Stack Engineer, AI Platform

Target Corp • Brooklyn Park (MN)

Hybrid
USD 132,000 - 238,000
Health benefits
401(k)
Paid time off
+1
Remote Lead AI Platform Engineer
Remote Lead AI Platform Engineer

UnitedHealth Group • Plymouth (MN)

Remote
USD 92,000 - 164,000
Telecommuting eligible
Staff AI Platform Engineer - Build Agent Tooling & SDLC
Staff AI Platform Engineer - Build Agent Tooling & SDLC

PrizePicks • United States

Remote
USD 220,000 - 250,000
Medical, dental, vision plans
401(k) match
Annual bonus
+3