Senior Ruby LLM Evaluation & Code-Review Specialist

AuraOne Human Data

United States

Remote

USD 110,000 - 165,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

AuraOne, Inc. is seeking a Senior Software Engineer to evaluate Ruby LLM outputs and validate repository correctness. You will assess code compilation, tests, and edge cases in a remote setting for US-eligible contractors.

You'll reproduce failures, write the minimal failing tests, and document patches the modeling team should target, ranking solutions with clear, senior-level justification.

Qualifications

  • Experience reading, running and debugging Ruby code in production-like tasks.
  • Ability to write focused unit tests demonstrating a single failure mode.
  • Familiarity with common testing frameworks across languages.

Responsibilities

  • Run and reproduce Ruby code outputs in a sandboxed environment.
  • Grade Ruby engineering solutions for correctness, style and edge cases.
  • Write minimal failing tests that demonstrate model bugs.
  • Compare paired solutions and rank them with rubric-based rationale.
  • Tag failure modes with severity scores and document defects.

Skills

Code review
Debugging
Unit testing
Software engineering judgment
Ruby engineering
Ruby
Software development

Tools

RSpec
Go test
pytest
JUnit
Jest

Job description

AuraOne, Inc. is seeking a Senior Software Engineer to evaluate Ruby LLM outputs and validate repository correctness. You will assess code compilation, tests, and edge cases in a remote setting for US-eligible contractors.

You'll reproduce failures, write the minimal failing tests, and document patches the modeling team should target, ranking solutions with clear, senior-level justification.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior LLM Evaluation & Code-Review Engineer
Remote Senior LLM Evaluation & Code-Review Engineer

AuraOne Human Data • United States

Remote
USD 83,000 - 138,000
Senior Software Engineer, LLM Evaluation & Review (Remote)
Senior Software Engineer, LLM Evaluation & Review (Remote)

AuraOne Human Data • United States

Remote
USD 69,000 - 124,000
Remote work
Contractor engagement
US-eligible
Senior Software Engineer, LLM Evaluation (Remote)
Senior Software Engineer, LLM Evaluation (Remote)

AuraOne, Inc. • United States

Remote
USD 83,000 - 165,000
Senior C# Engineer: LLM Evaluation & Code Quality
Senior C# Engineer: LLM Evaluation & Code Quality

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Senior Software Engineer - Ruby LLM Evaluation & Repository Validation
Senior Software Engineer - Ruby LLM Evaluation & Repository Validation

AuraOne Human Data • United States

Remote
USD 110,000 - 165,000
Remote Python LLM QA Engineer & Code Validator
Remote Python LLM QA Engineer & Code Validator

AuraOne, Inc. • United States

Remote
USD 83,000 - 138,000
Remote Senior Ruby Engineer — LLM Evaluation & Validation
Remote Senior Ruby Engineer — LLM Evaluation & Validation

Turing • United States

Remote
USD 83,000 - 124,000
Fully remote environment
Cutting-edge AI projects
Senior LLM Evaluation Engineer (JS/Python) – Remote
Senior LLM Evaluation Engineer (JS/Python) – Remote

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
Remote C/C++ Code Review Engineer for LLM Evaluation
Remote C/C++ Code Review Engineer for LLM Evaluation

AuraOne Human Data • United States

Remote
USD 55,000 - 96,000
Remote Senior Go Engineer: LLM Code Evaluation & Validation
Remote Senior Go Engineer: LLM Code Evaluation & Validation

AuraOne Human Data • United States

Remote
USD 96,000 - 165,000