Software Engineer - LLM evaluation (Remote) $60 - $90/hour · Contract · Posted 3 days ago $500 [...]

Mercor, Inc.; San Francisco (CA); Remote; USD 200,000 - 250,000; Part time

Job summary

Join a leading company in AI technology as a Software Engineer, focusing on evaluating AI models. You'll develop guidelines to enhance the quality and reliability of AI systems. This fully remote position offers flexible hours and competitive compensation based on your experience, with opportunities for extension.

Qualifications

• Hold a Computer Science degree from a top university.
• Have 2+ years of software engineering experience.

Responsibilities

• Create guidelines to assess AI-generated code quality.
• Contribute to high-impact AI projects.

Skills

Attention to detail

Written communication

Verbal communication

Education

Computer Science degree

Job description

Software Engineer - LLM evaluation (Remote)

Join an exciting project that pushes the boundaries of AI technology. As a Software Engineer focused on evaluating AI models, you will create detailed and clear guidelines to assess how well AI-generated code works. Your work will help improve the quality and reliability of advanced AI systems used around the world. There is a 15min assessment prior to selection. We anticipate selection to occur within two days of taking the assessment. This role will tentatively begin the week of January 13th 2025.

Currently, we are only accepting applicants from the U.S., UK, and Canada.

Why You’re a Great Fit

You’re an ideal candidate if you:

Hold a Computer Science degree from a top university in the U.S., Canada, or the UK.

Have 2+ years of software engineering experience.

Have exceptional attention to detail.

Excel in written and verbal communication.

Role Highlights

Work on a high-impact project contributing to the future of AI.

Flexible workload: 10–20 hours per week, with potential to increase to 40 hours.

Fully remote and asynchronous—work on your own schedule.

Minimum duration: 1–2 months, with potential for extension.

Compensation and Legal Details

• $60–$90/hour, depending on experience, paid weekly via Stripe Connect as a contractor.

About Mercor

Mercor specializes in recruiting experts for top AI labs and is based in San Francisco, CA.Our investors include Benchmark, General Catalyst, Peter Thiel, Adam D’Angelo, Larry Summers, and Jack Dorsey.

Apply today and make an impact with your expertise!

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Earn $500 by referring

Share the referral link below, and earn $500 for each successful referral through this unique link. There's no limit on how many people you can refer. Restrictions may apply. Learn more