Remote ML & NLP Expert for Evaluation & R&D

Weekday 1; United States; Remote; USD 110,000 - 152,000; Full time

Job summary

Weekday 1 is seeking experienced Machine Learning & NLP Experts to contribute to training and evaluating frontier AI models, designing challenging tasks, and creating high-quality reference solutions. You will assess model performance, identify gaps, and provide analyses in a remote, independent contractor role.

This part-time, fully remote opportunity requires about 20 hours per week and offers compensation of $80-$110 per hour, with weekly payments via Stripe or Wise.

Qualifications

• Deep hands-on experience in Machine Learning and/or NLP through industry, research, or graduate/PhD-level work.
• Strong proficiency in Python with practical experience developing ML or NLP applications.
• Strong understanding of modern ML techniques including Model Training and Evaluation, Transformer Architectures, LLMs, NLP Pipelines, and Feature Engineering.
• Experience with PyTorch, TensorFlow, Hugging Face Transformers, or equivalent.
• Ability to commit approximately 20 hours per week.
• Excellent written communication skills and the ability to work independently in a remote environment.

Responsibilities

• Design challenging, real-world ML and NLP tasks covering ML model development, NLP, IR, and LLMs.
• Develop accurate reference solutions and integrate tasks into agentic development environments using Python.
• Build executable evaluation frameworks and testing components where appropriate.
• Evaluate AI model outputs for technical correctness, reasoning quality, and overall performance.
• Identify capability gaps, classify model failure modes, and provide detailed analyses.
• Create and refine evaluation guidelines, scoring rubrics, and quality standards for ML and NLP tasks.
• Collaborate with subject matter experts to ensure consistency, accuracy, and high-quality training data.

Skills

Machine Learning

Natural Language Processing

Python

PyTorch

TensorFlow

HuggingFace Transformers

LLMs

Model Evaluation

NLP Pipelines

RAG

Tools

PyTorch

TensorFlow

HuggingFace Transformers

Job description

Weekday 1 is seeking experienced Machine Learning & NLP Experts to contribute to training and evaluating frontier AI models, designing challenging tasks, and creating high-quality reference solutions. You will assess model performance, identify gaps, and provide analyses in a remote, independent contractor role.

This part-time, fully remote opportunity requires about 20 hours per week and offers compensation of $80-$110 per hour, with weekly payments via Stripe or Wise.