AI Research Scientist (United States, Remote)

Rex.zone

United States

Remote

USD 41,328 - 68,880

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A tech company specializing in AI research is seeking a mid-senior level researcher to manage applied AI research projects. The role involves end-to-end research cycles, building and evaluating LLM systems, and collaborating on dataset development. The ideal candidate should have strong Python skills, LLM evaluation experience, and strong written communication skills. This is a remote, full-time position with competitive hourly compensation ranging from $30 to $50.

Qualifications

  • Mid-Senior experience delivering applied ML research or productionized ML evaluation.
  • Hands-on LLM evaluation, prompt evaluation, or RLHF experience.
  • Familiarity with dataset development: data labeling, QA evaluation, and guideline compliance checks.

Responsibilities

  • Own end-to-end applied research cycles: problem framing, baselines, ablations, and reporting.
  • Build and evaluate LLM systems using offline metrics and human-in-the-loop evaluation.
  • Perform error analysis and model debugging to improve robustness, safety, and helpfulness.

Skills

Python
Applied ML research
LLM evaluation
Experiment design
Strong written communication

Tools

PyTorch

Job description

AI Research Jobs in the United States (Remote, Full-Time)

You will run applied AI research projects for US-based customers via Rex.zone, translating open-ended research questions into measurable experiments across LLM evaluation, RLHF data design, prompt evaluation, and model performance improvement.

What You Will Do
  • Own end-to-end applied research cycles: problem framing, baselines, ablations, and reporting
  • Build and evaluate LLM systems using offline metrics and human-in-the-loop evaluation
  • Design RLHF workflows: preference data specs, rater instructions, prompt sets, and rubric-based grading
  • Create evaluation datasets and test suites: prompt evaluation, red-teaming prompts, and content safety labeling protocols
  • Collaborate with data labeling teams on taxonomy, edge-case coverage, and training data quality
  • Perform error analysis and model debugging to improve robustness, safety, and helpfulness
  • Document methodology and results for reproducibility and auditability
Required Qualifications
  • Mid-Senior experience delivering applied ML research or productionized ML evaluation
  • Strong Python skills; experience with PyTorch (or similar)
  • Hands-on LLM evaluation, prompt evaluation, or RLHF experience
  • Experiment design, metrics selection, and statistically sound interpretation
  • Familiarity with dataset development: data labeling, QA evaluation, and guideline compliance checks
  • Strong written communication for research artifacts and cross-functional alignment
Preferred Qualifications
  • RAG/NER/structured output evaluation experience
  • Exposure to computer vision or multimodal evaluation
  • Content safety labeling taxonomies and policy-aligned rubrics
  • MLOps for evaluation pipelines, dataset versioning, and reproducible runs
Remote Work and Collaboration

Remote, FULL_TIME role supporting United States-based projects with distributed teams across research, engineering, and data operations.

Compensation

Hourly base pay range: $30–$50/hr.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Research Scientist — Applied LLM Evaluation
Remote AI Research Scientist — Applied LLM Evaluation

AIToolboard • New York (NY)

Remote
USD 41,328 - 68,880
AI Research Jobs in Canada (Remote, Full-Time)
AI Research Jobs in Canada (Remote, Full-Time)

Rex.zone • United States

Remote
USD 41,328 - 68,880
Remote AI Engineer (United States)
Remote AI Engineer (United States)

Rex.zone • United States

Remote
USD 100,000 - 140,000
Remote Applied AI Research Scientist (LLM & Evaluation)
Remote Applied AI Research Scientist (LLM & Evaluation)

Rex.zone • United States

Remote
USD 41,328 - 68,880
AI Jobs in India — Remote AI Data Annotation Specialist
AI Jobs in India — Remote AI Data Annotation Specialist

Rex.zone • United States

Remote
USD 41,328 - 68,880
AI Research Engineer | Remote
AI Research Engineer | Remote

Crossing Hurdles • United States

Remote
USD 300,000 - 700,000
Senior AI Engineer (LLM Training & RLHF) - Remote
Senior AI Engineer (LLM Training & RLHF) - Remote

Prolific • Mesa (AZ)

On-site
USD 140,000 - 230,000
AI Product Manager
AI Product Manager

Rex.zone • United States

Remote
USD 110,000 - 150,000
Remote STEM Engineer (United States)
Remote STEM Engineer (United States)

Rex.zone • United States

Remote
USD 41,328 - 68,880
STEM Careers in the United States
STEM Careers in the United States

Rex.zone • United States

Remote
USD 41,328 - 68,880