Applied AI Engineer — Shape the Self-Improving Design Agent

Mixpeek

San Francisco, Northern (CA, KY)

Hybrid

USD 150,000 - 230,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Health coverage
Dental coverage
Vision coverage
20 days PTO
Team offsites

Job summary

Magic Patterns is seeking an AI engineer in San Francisco to own and advance the evaluation system powering the self-improving agent loop. You will push the boundaries of AI in design and collaborate with product teams to elevate agent quality from a user standpoint.

The role emphasizes building eval mechanisms, context-aware design enhancements, and contributing to post-training on design output, with a focus on real user impact and rapid iteration.

Qualifications

  • Experience building eval systems and self-improving agent loops.
  • Experience with AI models and design outputs.
  • Strong first-principles thinker who distills complex problems.

Responsibilities

  • Own our eval system that feeds into our self-improving agent loop.
  • Push and define the limits of what AI can do in design.
  • Collaborate with the product team to improve agent quality from the user perspective.
  • Decide what to work on to improve our AI Design agent. The listed items are open problems, not assignments.

Skills

AI design
Eval systems
Context engineering
First-principles thinker

Tools

PyTorch
TensorFlow

Job description

Magic Patterns is seeking an AI engineer in San Francisco to own and advance the evaluation system powering the self-improving agent loop. You will push the boundaries of AI in design and collaborate with product teams to elevate agent quality from a user standpoint.

The role emphasizes building eval mechanisms, context-aware design enhancements, and contributing to post-training on design output, with a focus on real user impact and rapid iteration.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Applied AI Engineer: Shape Self-Improving Design Agents
Applied AI Engineer: Shape Self-Improving Design Agents

Magic Patterns • San Francisco (CA)

On-site
USD 150,000 - 210,000
Rapid career growth
Equity package
20 days off PTO
+2
Applied AI Engineer
Applied AI Engineer

Magic Patterns • San Francisco (CA)

On-site
USD 150,000 - 210,000
Rapid career growth
Equity package
20 days off PTO
+2
Applied AI Engineer
Applied AI Engineer

Mixpeek • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 230,000
Health coverage
Dental coverage
Vision coverage
+2
Lead AI Agent Engineer
Lead AI Agent Engineer

Improving • Dallas (TX), Northern (KY)

Hybrid
USD 140,000 - 210,000
AI-First Product Designer — End-to-End Ownership & Growth
AI-First Product Designer — End-to-End Ownership & Growth

Mixpeek • San Francisco (CA)

On-site
USD 120,000 - 170,000
Equity
Health, dental, and vision coverage
15 days PTO
Software Engineer – AI Systems & Data Pipelines
Software Engineer – AI Systems & Data Pipelines

Magic • San Francisco (CA)

On-site
USD 200,000 - 550,000
Equity
401(k) matching
Health insurance
+3
AI-Driven UX Software Engineer
AI-Driven UX Software Engineer

Google DeepMind • San Francisco (CA)

Hybrid
USD 150,000 - 190,000
AI Engineer – Onsite – San Francisco, CA
AI Engineer – Onsite – San Francisco, CA

RS Global Services • San Francisco (CA)

On-site
USD 150,000 - 230,000
Research Scientist: AI Self-Improvement & Evaluation
Research Scientist: AI Self-Improvement & Evaluation

Anthropic • San Francisco (CA)

Hybrid
USD 350,000 - 850,000
Competitive compensation
Equity donation matching
Generous vacation and parental leave
+2
Autonomous AI Engineer — Shape a Multi-Agent Platform with Equity
Autonomous AI Engineer — Shape a Multi-Agent Platform with Equity

Fuel Talent LLC • Bellevue (WA), Northern (KY)

Hybrid
USD 150,000 - 300,000