Remote Senior Software Advisor (LLM) - 34953

Turing; Bengaluru; Remote; INR 6,026,246 - 18,078,739; Part time

Benefits offered by this job

Flexible work hours

Impactful project in AI

Job summary

A leading AI development company is seeking a Remote Senior Software Advisor to evaluate AI-generated code and improve next-generation systems. Ideal candidates will have 5+ years in software engineering, experience as a Fullstack Engineer, and skills in analyzing Git diffs. This role offers flexible hours and competitive compensation ranging from $50 to $150/hour based on experience.

Qualifications

• 5+ years of professional software engineering experience.
• 2+ years as a Fullstack Engineer at a top-tier tech product company.
• Experience evaluating LLM-generated code is a plus.

Responsibilities

• Assess AI-generated code for quality and correctness.
• Rank multiple code outputs based on established guidelines.
• Work with a team to enhance evaluation standards.

Skills

Analyzing Git-style diffs

Structured reasoning

Following rubrics and guidelines

Education

Degree from a top university

Job description

Remote Senior Software Advisor (LLM) - 34953

Remote Senior Software Advisor (LLM) - 34953

4 days ago Be among the first 25 applicants

We are seeking experienced software engineers to help evaluate how well AI models handle real software engineering problems. This is a short-term, high-impact role where your engineering expertise will directly influence the training and assessment of next-generation AI systems built for developers.

You’ll be working with a global AI company on a specialized project focused on analyzing code produced by Large Language Models (LLMs). The goal: make these models better at reading, writing, and understanding real-world code.

What You’ll Do

• Assess AI-generated code for quality, correctness, readability, and efficiency
• Compare multiple code outputs and rank them using clear guidelines
• Review code diffs from actual GitHub projects and judge their effectiveness
• Write concise explanations to support each ranking decision
• Identify edge cases or confusing outputs that indicate AI weaknesses
• Work with a team of experts to improve evaluation standards and datasets

Must-Have Requirements

Please do not apply unless you meet all of the following baseline requirements:

• Experience:
• 5+ years of overall professional software engineering experience (experience working as a data scientist will not be considered)
• 2+ years working full-time as a Fullstack Engineer at a top-tier tech product company
• Companies include Google, Datadog, Shopify, Meta, Canva, Amazon, and others.

Note: Contract-only or part-time roles will not be considered as experience

• You are skilled at reading and analyzing Git-style diffs
• You can write clear, structured reasoning to explain technical choices
• You follow rubrics and guidelines to ensure fair, structured evaluations

Nice to Have

• Exposure to LLM-generated code or prior experience evaluating model outputs
• Degree from a top university (not required, but preferred)
• Background in developer tools, automation, or open-source contributions
• Experience with AI research or evaluation workflows
• Duration: 1 month to start (with possible extensions)
• Hours: Flexible work hours with commitment of 10-20 hours/week (must have some overlap with Pacific Time)
• Compensation: $50–$150/hour (based on experience and skill level)
• Start Date: Immediate openings available (next week)

About Turing:

Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.

Why Join Turing?

• Be part of a cutting-edge AI project helping shape how developers work with code
• Collaborate with world-class AI researchers and engineers
• Apply your skills in a meaningful way—on real software, not theoretical examples

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at Turing by 2x

Get notified about new Software Specialist jobs in Bengaluru, Karnataka, India.

Lead/Senior Customer Success Manager – Commercial & SMB (US Shift)

Senior Business Analyst - Insurance (Fully Remote)

Senior Consultant - Client Acquisition | Selling AI / ML / Supply Chain / Advanced Analytics - Commission-based Model (Remote)

Senior Business Analyst - India - Fully Remote

Senior Customer Success Manager, Payroll | APAC

Senior Social Media Listening Analyst - Pharma and Life Sciences

HSO - GS - SCM Functional Senior Consultant - Remote - Immediate Interviews

Sr Principal Customer Success Consultant

Senior Manager / BDM: Business Development – Europe

Sales Excellence – Competitive & Market Intelligence Advisor

HSO GS - MS Dynamics 365 FO Senior SCM Functional Consultant

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.