Remote Senior Software Engineer - LLM Benchmarking

SaidGig; New York (NY); Teletrabalho; USD 120 000 - 180 000; Tempo parcial

Resumo da oferta

SaidGig is seeking a software engineer to help advance AI language models by creating high-quality datasets, benchmarks, and evaluations. You will work across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go to develop reference solutions and assess AI-generated output for engineering quality.

You will curate code examples, refine AI-driven coding solutions, and partner with researchers and product teams to ensure performance against industry benchmarks.

Qualificações

• Several years of software engineering experience at a top-tier product company.
• Strong full-stack development ability and ability to deploy production-grade software.
• Deep knowledge of architecture, design, debugging, and code quality.
• Excellent written and verbal communication with structured evaluation rationales.

Responsabilidades

• Curate code examples, build solutions, and correct code across multiple languages for AI model training initiatives.
• Evaluate and refine AI-generated code for efficiency, scalability, and reliability.
• Partner with cross-functional teams to improve AI-driven coding solutions against benchmarks.
• Build agents that verify code quality and identify recurring error patterns.
• Develop and assess model capabilities across the software lifecycle, including prototyping, architecture design, API design, production implementation, launch, experiments, monitoring, operations, and maintenance.
• Design automated verification mechanisms for solutions to software engineering tasks.

Conhecimentos

Full-stack development

Production-grade software

Code review

Communication

Experience with AI datasets

Ferramentas

Python

JavaScript/ReactJS

C/C++

Java

Rust

Go

Descrição da oferta de emprego

SaidGig is seeking a software engineer to help advance AI language models by creating high-quality datasets, benchmarks, and evaluations. You will work across Python, JavaScript (ReactJS), C/C++, Java, Rust, and Go to develop reference solutions and assess AI-generated output for engineering quality.

You will curate code examples, refine AI-driven coding solutions, and partner with researchers and product teams to ensure performance against industry benchmarks.