Lead Engineer, AI Quality (Fully Remote)

Circle; United States; Remote; USD 180,000 - 300,000; Full time

Benefits offered by this job

Health and wellbeing support

Global retreats

Equity

35 days PTO

Fully remote work

Job summary

Circle builds an AI-powered all-in-one platform for digital businesses, uniting audiences with discussions, live streams, events, chat, courses, and payments. It's a fully remote team of about 270 people from 30+ countries, with an async culture and annual global offsites.

The role focuses on building evaluation and observability for Circle's AI agents and guiding a hands-on team to set technical direction and priorities, while aligning with company values.

Qualifications

• 7+ years shipping production software with LLM-powered agents.
• Proficiency in Rails and Python; experience with eval frameworks.
• CEFR C2 level English and alignment with Circle values.

Responsibilities

• Build evaluation and observability infrastructure for Circle's AI agents.
• Lead a hands-on team setting technical direction and priorities.

Skills

LLM agents

Rails

Python

Eval framework

English C2

Job description

• Build evaluation and observability infrastructure for Circle's AI agents.
• Lead a hands-on team setting technical direction and priorities.

What We're Looking For:

• 7+ years shipping production software with LLM-powered agents.
• Rails/Python skills and eval framework experience.
• CEFR C2 English and alignment with company values.
• U.S.-benchmarked salary, equity, and 35 days PTO.
• Fully remote with global retreats and health/wellbeing support.

Circle

Circle builds an AI-powered all-in-one platform for digital businesses, uniting audiences with discussions, live streams, events, chat, courses, and payments. It's a fully remote team of about 270 people from 30+ countries, with an async culture and annual global offsites.