Remote ML Infrastructure Engineer for LLM Benchmarking

engineeringjobs.net, Inc.; Pittsburgh (Allegheny County); Remote; USD 120,000 - 160,000; Full time

Job summary

Turing is seeking a seasoned software engineer to create and refine high-quality datasets and code examples for training and benchmarking large language models, and to build automated verification tools and Python agents to evaluate AI-generated code for efficiency and scalability.

Candidates should have at least 3 years of software engineering experience with deep Python expertise and a solid grasp of full-stack deployment and software architecture.

Qualifications

• Requires at least 3 years of software engineering experience with deep expertise in Python and full-stack application deployment.
• Strong understanding of software architecture and excellent communication skills for providing structured evaluation rationales are essential.

Responsibilities

• Create and refine high-quality datasets and code examples to train and benchmark large language models.
• Build automated verification tools and agents in Python to evaluate AI-generated code for efficiency and scalability.

Skills

Python

JavaScript

ReactJS

C/C++

Java

Rust

Go

Software Architecture

Full-stack Development

ML Infrastructure

Data Pipelines

Code Review

Debugging

API Design

Automated Verification Tools

Large Language Models

Job description

Turing is seeking a seasoned software engineer to create and refine high-quality datasets and code examples for training and benchmarking large language models, and to build automated verification tools and Python agents to evaluate AI-generated code for efficiency and scalability.

Candidates should have at least 3 years of software engineering experience with deep Python expertise and a solid grasp of full-stack deployment and software architecture.