Senior AI Evaluation Engineer - Remote Data Pipelines

Socket.dev; United States; On-site; USD 196,000 - 227,000; Full time

Job summary

Airbnb is seeking a Senior Software Engineer for the AI Assistant Product Evaluation team. You will design scalable data systems and evaluation platforms for agentic AI products, working at the crossroads of backend engineering, data systems, AI evaluation, and product quality.

You will partner with modeling teams, product managers, data scientists, and operations to translate AI evaluation needs into robust systems that enable trustworthy AI experiences at scale.

Qualifications

• 5+ years of industry experience as a software engineer, backend engineer, platform engineer, or data-focused software engineer building production systems.

Responsibilities

• Design and build scalable data systems and evaluation platforms for agentic AI products.
• Work at the intersection of backend engineering, data systems, AI evaluation, and product quality.
• Define how Airbnb measures, monitors, and improves AI product quality at scale.
• Collaborate with modeling teams, product managers, data scientists and operations to deliver end-to-end solutions.

Job description

Airbnb is seeking a Senior Software Engineer for the AI Assistant Product Evaluation team. You will design scalable data systems and evaluation platforms for agentic AI products, working at the crossroads of backend engineering, data systems, AI evaluation, and product quality.

You will partner with modeling teams, product managers, data scientists, and operations to translate AI evaluation needs into robust systems that enable trustworthy AI experiences at scale.