Agent Engineer

Coframe; San Francisco (CA); On-site; USD 130,000 - 170,000; Full time

Benefits offered by this job

Flexible (Unlimited) Paid Time Off

Medical, Dental, and Vision benefits

Life Insurance and Disability Benefits

401k Plan with company match

Meals covered in-office

Gym membership

Job summary

A cutting-edge tech company in San Francisco is seeking an Agent Engineer to develop systems that create and monitor AI interfaces. The ideal candidate will have experience in building production AI systems and a strong sense of software engineering. Responsibilities include developing validation systems, monitoring outputs post-launch, and optimizing workflows. The role offers flexible paid time off, comprehensive medical benefits, and opportunities for growth in a rapidly expanding environment.

Qualifications

• Experience in building production AI systems, agent workflows, and LLM pipelines.
• Ability to ship reliable non-deterministic systems.
• Strong understanding of web and product sense for optimal outputs.

Responsibilities

• Build AI agents for generating interfaces and client-side features at scale.
• Create validation systems to catch bugs and poor user experiences.
• Establish monitoring systems to detect issues post-launch.

Skills

Built production AI systems

Strong software engineering fundamentals

Experience with LLMs

Strong web experience

Ability to communicate with non-technical partners

Job description

We’re looking for Agent Engineers to build systems that generate, test, monitor interfaces at scale.

This team enables the creation of hundreds of thousands of on-brand, production-ready experiences (Web and beyond) with strong automated QA loops and continuous monitoring systems.

Each improvement here increases optimization space, experimentation velocity, and thus, lift.

You’re a great fit if you have:

• Built production AI systems, agent workflows, LLM pipelines
• Strong software engineering fundamentals and ability to ship reliable non-derministic systems
• Experience with LLMs, tool use, evaluation systems, and parallel execution.
• Strong web experience and product sense for what good outputs look like
• Ability to talk to customer, non-technical partners to convert requirements into: technologies and processes.

What you'll do:

• Build AI agents that generate interfaces, client-side features, and more at scale.
• Create validation systems that catch bugs, off-brand outputs, and poor user experiences before launch
• Create online and offline evaluation systems for generated outputs
• Build monitoring systems that detect issues and regressions after rollout
• Improve orchestration between generation, QA, rollout, and learning loops
• Consistently turn manual workflows into scalable and reliable agents
• Talk to technical and non-technical teams to capture qualitative feedback and convert it to the metrics and improvements

Benefits:

• Flexible (Unlimited) Paid Time Off
• Medical, Dental, and Vision benefits for you and your family
• Life Insurance and Disability Benefits
• 401k Plan with Coframe match
• Meals covered in-office
• Gym membership

About us:

• At Coframe, we are building a future where user and agent interfaces can adapt, evolve, and personalize themselves.
• We are a primarily in-person company based in San Francisco.
• We are well-capitalized with backing from Khosla Ventures, Nat Friedman, the founder of Android, and others.
• We are generating revenue, growing rapidly, and trusted by companies you definitely know.
• Our team is small and talent-dense, consisting of competitive programmers, former founders (our founder previously co-founded a unicorn), and AI researchers from top institutions who have created a few of the most popular OSS code generation projects.