Senior Software Security Engineer - AI Evaluation Pod Lead

AuraOne Human Data

United States

Remote

USD 83,000 - 165,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

AuraOne is seeking a Senior Software Security Engineer - Pod Lead for AI Evaluation as a remote contractor role focused on evaluating production code and model outputs. You will reproduce failures, craft tests, and provide fixes guidance to help the modeling team target gaps.

The role emphasizes strong engineering judgment, concise test writing, and the ability to clearly explain the reasoning behind findings to other senior engineers. Remote-US eligible with flexible hours.

Qualifications

  • Strong day-job engineering experience with reading, running, and debugging unfamiliar code.
  • Ability to write concise unit tests capturing a single failure mode.
  • Familiarity with a testing framework (pytest, Jest, JUnit, Go test, RSpec).
  • Clear written reasoning to convince senior engineers.
  • Available for at least 10 hours per week remotely.
  • Prior code-review or technical-interview grading is a plus.

Responsibilities

  • Run and reproduce candidate code outputs in a sandboxed environment.
  • Grade solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests demonstrating bugs.
  • Compare paired solutions with rationale tied to rubric.
  • Tag failure modes with severity scores.
  • Document recurring code-generation failures for targeting.
  • Calibrate reviews to maintain high inter-rater agreement.

Skills

Code review
Debugging
Unit testing
Engineering judgment
Pod Lead review
Cyber Security
Cloud Infrastructure

Tools

pytest
JUnit
Go test
RSocket

Job description

AuraOne is seeking a Senior Software Security Engineer - Pod Lead for AI Evaluation as a remote contractor role focused on evaluating production code and model outputs. You will reproduce failures, craft tests, and provide fixes guidance to help the modeling team target gaps.

The role emphasizes strong engineering judgment, concise test writing, and the ability to clearly explain the reasoning behind findings to other senior engineers. Remote-US eligible with flexible hours.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer, AI Evaluation & Coding Agents
Senior Software Engineer, AI Evaluation & Coding Agents

AuraOne Human Data • United States

Remote
USD 138,000 - 207,000
Remote Senior AI Data Review Engineer
Remote Senior AI Data Review Engineer

AuraOne, Inc. • United States

Remote
USD 141,000 - 190,000
Senior AI Security Engineer & Code Reviewer (Remote)
Senior AI Security Engineer & Code Reviewer (Remote)

AuraOne Human Data • United States

Remote
USD 83,000 - 152,000
Remote Engineering Manager, AI Security Operations & Review
Remote Engineering Manager, AI Security Operations & Review

AuraOne Human Data • United States

Remote
USD 83,000 - 152,000
Senior Intelligence Analyst — Security AI Evaluation Remote
Senior Intelligence Analyst — Security AI Evaluation Remote

AuraOne Human Data • United States

Remote
USD 55,000 - 83,000
Senior Software Security Engineer - Pod Lead, AI Evaluation
Senior Software Security Engineer - Pod Lead, AI Evaluation

AuraOne Human Data • United States

Remote
USD 83,000 - 165,000
AI Code Review Engineer — Remote (US-Based)
AI Code Review Engineer — Remote (US-Based)

AuraOne Human Data • United States

Remote
USD 83,000 - 152,000
Remote AI Data Evaluation Engineer – Code Review & Testing
Remote AI Data Evaluation Engineer – Code Review & Testing

AuraOne Human Data • United States

Remote
USD 68,000 - 97,000
Remote AI Evaluation Engineer — Civil Code Reviewer
Remote AI Evaluation Engineer — Civil Code Reviewer

AuraOne Human Data • United States

Remote
USD 102,000 - 146,000
Senior Forward-Deployed Engineer, Public-Sector AI - Remote
Senior Forward-Deployed Engineer, Public-Sector AI - Remote

AuraOne, Inc. • United States

Remote
USD 83,000 - 165,000