Applied AI Engineer

Magic Patterns; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Rapid career growth

Equity package

20 days off PTO

Health, dental, and vision coverage

Team offsites and events

Job summary

Magic Patterns seeks an AI-focused engineer to own the eval system powering a self-improving agent loop and to push the boundaries of AI-driven design. You will collaborate with product teams to translate user perspectives into robust AI solutions, shaping how our design agent evolves.

You will work on eval systems, post-training, and context engineering, combining first-principles thinking with practical experimentation to drive product excellence.

Qualifications

• Experience building eval systems for AI agents.
• Experience with AI models and/or AI agents.
• Experience building eval systems, post-training, context engineering.
• Strong first-principles thinker who can distill complex problems.

Responsibilities

• Own our eval system that feeds into our self-improving agent loop.
• Push and define the limits of what AI can do in design.
• Collaborate with the product team to bring novel solutions to improve agent quality from the user's perspective.
• Decide what to work on to improve our AI Design agent.

Skills

Eval systems

Context engineering

AI agents

First-principles thinking

AI models

Job description

About Magic Patterns

Our mission is to let anyone build delightful software. We're a lean team where everyone contributes directly to the product.

If you’re an AI engineer, our roadmap is probably a goldmine of things you’ve always wanted to work on:

• An AI agent that thousands of users use religiously everyday


• Evals with a self-improving agent loop


• Context engineering


• Post-training on design output

The most common piece of feedback we get is \"I tried a bunch of tools but your design quality output is by far the best.\" We want to push the limits even further.

About this role

• Own our eval system that feeds into our self-improving agent loop


• Push and define the limits of what AI can do in design. Today, we are state of the art, and we want to continue to push that.


• Collaborate with the product team to bring novel solutions to improve agent quality from the perspective of our users


• Decide what to work on to improve our AI Design agent. The list above are open problems, not assignments

This role might be a fit if you...

• Use AI tools in your daily workflow


• Have experience with AI models and/or have worked on an AI agent before


• Have experience building eval systems, post-training, context engineering


• Strong first-principles thinker that can distill complex problems

Our Values

1. Obsessive — we love exploring every corner of the hardest problems.


2. Growth-minded — where you are today matters less than how fast you are growing


3. Ownership — insist on high standards and craftsmanship.


4. Spread the magic — for many people, Magic Patterns is “magic.” Be proud of your work and have fun!

Compensation and benefits:

• Rapid career growth at one of the fastest growing Series A companies


• Competitive salary and equity package


• 20 days off PTO


• Health, dental, and vision coverage


• Fun team offsites and events — we went to Mexico last year!