Senior AI Model Evaluation Engineer — Hybrid, Bay Area

SaidGig; Palm Bay (FL); Hybrid; USD 90,000 - 145,000; Full time

Job summary

SaidGig is seeking a seasoned engineer to help frontier AI models reason about real-world software development and engineered systems. You will work with an AI research and program management team to define high-quality engineering work, evaluate model performance, and turn expert practice into clear standards.

Key responsibilities include designing benchmarking tasks, reviewing complex code and edge cases, and mentoring through concrete criteria.

Qualifications

• Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline.
• An MS or PhD is strongly preferred.
• At least 4 years of substantive professional engineering experience building and shipping production software or engineered systems.

Responsibilities

• Review engineering knowledge-work tasks and model outputs, identifying missing behaviors and weak reasoning.
• Create detailed instruction specifications, golden solutions, and new engineering tasks.
• Design demanding engineering benchmarks and evaluation sets that measure meaningful model improvement.
• Collaborate with researchers and specialists to translate tacit engineering judgment into explicit criteria.

Skills

Distributed systems

Backend infrastructure

Security & cryptography

ML systems

Dev tooling & platform

Quality & testing

LLM familiarity

Written communication

Education

Bachelor's degree in CS/SE or related

MS or PhD preferred

Job description

SaidGig is seeking a seasoned engineer to help frontier AI models reason about real-world software development and engineered systems. You will work with an AI research and program management team to define high-quality engineering work, evaluate model performance, and turn expert practice into clear standards.

Key responsibilities include designing benchmarking tasks, reviewing complex code and edge cases, and mentoring through concrete criteria.