Remote Senior Software Engineer (LLM) - 34953

Turing; United States; Remote; USD 70,000 - 100,000; Part time

Job summary

A leading AI company is seeking a Remote Senior Software Engineer with a focus on Large Language Models. You will collaborate with AI researchers to evaluate code outputs and ensure quality assessments within significant software projects. This role requires robust software engineering experience and a strong foundation in debugging and code evaluation.

Qualifications

• 7+ years of professional software engineering experience.
• Strong fundamentals in software design and debugging.
• Exceptional written communication skills.

Responsibilities

• Review and rank model-generated code responses.
• Evaluate code for correctness and quality.
• Provide detailed rationales for ranking decisions.

Skills

Software design

Coding best practices

Debugging

Code quality assessment

Written communication

LLM evaluation work

Job description

Remote Senior Software Engineer (LLM) - 34953

Remote Senior Software Engineer (LLM) - 34953

21 hours ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

Project Overview

We're building high-quality evaluation and training datasets to improve how Large Language Models (LLMs) interact with realistic software engineering tasks. A key focus of this project is curating verifiable software engineering challenges from public GitHub repository histories using a human-in-the-loop process.

Why This Role Is Unique

• Collaborate directly with AI researchers shaping the future of AI-powered software development.
• Work with high-impact open-source projects and evaluate how LLMs perform on real bugs, issues, and developer tasks.
• Influence dataset design that will train and benchmark next-gen LLMs.
• What does day-to-day look like:
• Review and compare 3–4 model-generated code responses for each task using a structured ranking system.
• Evaluate code diffs for correctness, code quality, style, and efficiency.
• Provide clear, detailed rationales explaining the reasoning behind each ranking decision.
• Maintain high consistency and objectivity across evaluations.
• Collaborate with the team to identify edge cases and ambiguities in model behavior.

Required Skills

• 7+ years of professional software engineering experience, ideally at top-tier product companies (e.g., Stripe, Datadog, Snowflake, Dropbox, Canva, Shopify,Intuit,PayPal, Research at IBM/GE/Honewell/Scheinder etc. ).
• Strong fundamentals in software design, coding best practices, and debugging.
• Excellent ability to assess code quality, correctness, and maintainability.
• Proficient with code review processes and reading diffs in real-world repositories.
• Exceptional written communication skills to articulate evaluation rationale clearly.
• Prior experience with LLM-generated code or evaluation work is a plus.

Bonus Points

• Experience in LLM research, developer agents, or AI evaluation projects.
• Background in building or scaling developer tools or automation systems.
• Commitment: ~20 hours/week (partial PST overlap required)
• Type: Contractor (no medical/paid leave)
• Duration: 1 month (starting next week; potential extensions based on performance and fit)

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology and Engineering

• Industries

  Software Development

Referrals increase your chances of interviewing at Turing by 2x

Sign in to set job alerts for “Software Engineer” roles.

Full-Stack Software Engineer (New graduates: United States)

United States $70,000.00-$100,000.00 2 weeks ago

Software Engineer, Early Career - Messaging API

Software Engineer (L5) - Open Connect Platform

New York, NY $140,000.00-$185,000.00 1 week ago

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

United States $100,000.00-$720,000.00 2 weeks ago

Software Engineer (L5) - Ads Identity & Privacy

United States $100,000.00-$720,000.00 2 weeks ago

New York, United States $142,600.00-$196,200.00 1 week ago

United States $140,000.00-$170,000.00 1 month ago

Software Engineer Intern/Co-op (Fall 2025)

New York, NY $145,000.00-$260,000.00 7 months ago

United States $90,000.00-$170,000.00 9 months ago

California, United States $100,000.00-$720,000.00 5 days ago

Software Engineer, Full Stack (Platform)

United States $125,000.00-$150,000.00 14 hours ago

New York City Metropolitan Area 1 week ago

Software Engineer L4/L5, Training Platform, Machine Learning Platform

United States $100,000.00-$720,000.00 1 week ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.