Remote Senior Software Engineer (LLM) - 34953

California Jobs; Santa Clara (CA); Remote; Full time

Job summary

A leading company in AI and software development seeks a Senior Software Engineer to evaluate model-generated code. This role offers competitive pay, the chance to work on innovative LLM projects, and collaboration with AI researchers. Ideal candidates are experienced professionals with strong software design fundamentals and excellent communication skills.

Qualifications

• 7+ years of professional software engineering experience at top-tier companies.
• Strong understanding of software design and debugging.
• Exceptional written communication skills.

Responsibilities

• Review and rank model-generated code responses using a structured system.
• Evaluate code correctness, quality, and efficiency.
• Collaborate with the team on ambiguities in model behavior.

Skills

Software design

Coding best practices

Debugging

Code quality assessment

Communication skills

Job description

Remote Senior Software Engineer (LLM) - 34953

Pay 100.00 / hour

Employment type Full-Time

Job Description

Req#: 32761814923 Employer Industry: AI and Software Development

Why consider this job opportunity:
- Competitive hourly rates ranging from $40–$100, based on experience and skill level
- Opportunity to collaborate directly with AI researchers and influence the future of AI-powered software development
- Engage with high-impact open-source projects and real-world software engineering tasks
- Chance to work on innovative dataset design that will train and benchmark next-gen Large Language Models (LLMs)
- Flexible commitment of approximately 20 hours per week, with potential for contract extensions based on performance

What to Expect (Job Responsibilities):
- Review and compare 3–4 model-generated code responses for each task using a structured ranking system
- Evaluate code diffs for correctness, code quality, style, and efficiency
- Provide clear, detailed rationales explaining the reasoning behind each ranking decision
- Maintain high consistency and objectivity across evaluations
- Collaborate with the team to identify edge cases and ambiguities in model behavior

What is Required (Qualifications):
- 7+ years of professional software engineering experience, ideally at top-tier product companies
- Strong fundamentals in software design, coding best practices, and debugging
- Excellent ability to assess code quality, correctness, and maintainability
- Proficient with code review processes and reading diffs in real-world repositories
- Exceptional written communication skills to articulate evaluation rationale clearly

How to Stand Out (Preferred Qualifications):
- Experience in LLM research, developer agents, or AI evaluation projects
- Background in building or scaling developer tools or automation systems

#AI #SoftwareDevelopment #ContractOpportunity #CompetitivePay #OpenSourceProjects

We prioritize candidate privacy and champion equal-opportunity employment. Central to our mission is our partnership with companies that share this commitment. We aim to foster a fair, transparent, and secure hiring environment for all. If you encounter any employer not adhering to these principles, please bring it to our attention immediately.
We are not the EOR (Employer of Record) for this position. Our role in this specific opportunity is to connect outstanding candidates with a top-tier employer.

About the company

Notice

Talentify is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Talentify provides reasonable accommodations to qualified applicants with disabilities, including disabled veterans. Request assistance at [e-mail] or 407-000-0000.

Federal law requires every new hire to complete Form I-9 and present proof of identity and U.S. work eligibility.

An Automated Employment Decision Tool (AEDT) will score your job-related skills and responses. Bias-audit & data-use details: www.talentify.io/bias-audit-report . NYC applicants may request an alternative process or accommodation at [e-mail] or 407-000-0000.