Remote Senior Software Engineer: AI Code Evaluation

24-Mag Llc; United States; Remote; USD 14,000 - 55,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Contract-based

Job summary

24-MAG LLC is seeking experienced software engineers for a part-time, fully remote consulting role focused on evaluating advanced language models and coding benchmarks. You will curate code, verify solutions, and assess AI-generated software across languages, contributing to research collaboration and reproducible evaluation processes.

Ideal candidates have 3+ years in software engineering, strong full-stack skills, and familiarity with Python, JavaScript, Java, C++, Rust, or Go.

Qualifications

• 3+ years of professional software-engineering experience.
• Strong full-stack development capabilities.
• Experience building scalable, production-grade software.
• Deep knowledge of development, debugging, and code-quality assessment.

Responsibilities

• Curate high-quality code examples for model training and benchmarking.
• Develop precise solutions to software-engineering tasks across multiple languages.
• Evaluate AI-generated code for technical correctness and efficiency.
• Assess software design, architecture, and production implementation decisions.
• Collaborate with research and cross-functional teams on evaluation strategies.

Skills

Python

JavaScript

Java

C++

Rust

Go

ReactJS

Job description

24-MAG LLC is seeking experienced software engineers for a part-time, fully remote consulting role focused on evaluating advanced language models and coding benchmarks. You will curate code, verify solutions, and assess AI-generated software across languages, contributing to research collaboration and reproducible evaluation processes.

Ideal candidates have 3+ years in software engineering, strong full-stack skills, and familiarity with Python, JavaScript, Java, C++, Rust, or Go.