Delivery Engineer for AI Security & Evaluation

AIUC

San Francisco (CA)

On-site

USD 140,000 - 210,000

Full time

9 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Competitive salary and meaningful equ»
Comprehensive medical, dental, and VIS
Visa sponsorship and relocation to SF
Team focused on doing the best work of

Job summary

AIUC in San Francisco is seeking an engineer to own end-to-end evaluation workflows for enterprise AI safety. You will read partner API docs, integrate with customer systems, and run evaluations against live agents.

You’ll build custom integrations, deliver results to customers, decide if agents meet AIUC-1 standards, and collaborate across Delivery, Core Engineering, Sales, and Standards teams while turning field learnings into product improvements.

Qualifications

  • 3-7 years of experience in an early engineer role owning customers or in an integration/solutions/forward deployed capacity.
  • Ability to build and debug integrations and know when a scrappy version is appropriate.
  • Comfort in owning customer relationships—scoping work, setting expectations, delivering bad news early.
  • Customer obsession: the customer problem is your problem and you see it through.
  • Discipline to turn field observations into reusable solutions rather than repeating problems.

Responsibilities

  • Own the path from signed customer to delivered results—scoping tests, handling authentication/interfaces, and getting the agent running in our system.
  • Build one-off versions when a customer doesn’t fit the product and make it work anyway.
  • Deliver results directly to the customer and be trusted for technical detail.
  • Decide whether a customer meets the AIUC-1 standard.
  • Collaborate across Delivery, Core Engineering, Sales, and Standards teams and with the customer’s own engineering team.
  • Turn field learnings into product improvements.

Skills

API integration
Customer relationship
Software debugging
Field-to-product insight

Tools

APIs

Job description

AIUC in San Francisco is seeking an engineer to own end-to-end evaluation workflows for enterprise AI safety. You will read partner API docs, integrate with customer systems, and run evaluations against live agents.

You’ll build custom integrations, deliver results to customers, decide if agents meet AIUC-1 standards, and collaborate across Delivery, Core Engineering, Sales, and Standards teams while turning field learnings into product improvements.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

End-to-End Delivery Engineer, AI Evaluation & Standards
End-to-End Delivery Engineer, AI Evaluation & Standards

Socket.dev • San Francisco (CA)

On-site
USD 180,000 - 270,000
Competitive salary
Meaningful equity
Visa sponsorship and relocation to San
+1
Delivery Engineer: AI Safety & Enterprise Evaluations
Delivery Engineer: AI Safety & Enterprise Evaluations

Artificial Intelligence Underwriting Company • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive salary
Equity
Relocation to San Francisco
+1
AI Engineer – Onsite – San Francisco, CA
AI Engineer – Onsite – San Francisco, CA

RS Global Services • San Francisco (CA)

On-site
USD 150,000 - 230,000
Agent Evaluation Infrastructure Engineer
Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 190,000
AI Alignment Research Engineer — Evaluation & Safety
AI Alignment Research Engineer — Evaluation & Safety

W3 Sourcing • San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Enterprise AI Agent Evaluation Infrastructure Engineer
Enterprise AI Agent Evaluation Infrastructure Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 190,000
Remote AI Engineer, Quality & Evaluation at Enterprise Scale
Remote AI Engineer, Quality & Evaluation at Enterprise Scale

Fieldguide • San Francisco (CA)

Hybrid
USD 120,000 - 160,000
Competitive compensation packages
Flexible PTO
401k
+3
Enterprise AI Evaluation Environments Engineer
Enterprise AI Evaluation Environments Engineer

MaxIT Consulting - Max Corporate Group • San Francisco (CA)

On-site
USD 140,000 - 210,000
AI Evaluation Engineer: Build AI Test Suites & Quality Gates
AI Evaluation Engineer: Build AI Test Suites & Quality Gates

Zof AI • San Francisco (CA), Northern (KY)

Hybrid
USD 120,000 - 160,000
Member of technical staff - Delivery
Member of technical staff - Delivery

Artificial Intelligence Underwriting Company • San Francisco (CA)

On-site
USD 180,000 - 230,000
Competitive salary
Equity
Relocation to San Francisco
+1