Remote AI/ML Engineer — LLM Training & Evaluation

Rex.zone; United States; Remote; USD 41,328 - 68,880; Full time

Job summary

A technology company in the United States is seeking remote, full-time engineers with STEM backgrounds. Candidates will work on AI/ML systems, focusing on building and improving training pipelines for large language models. Responsibilities include designing ML components, collaborating on annotation guidelines and quality checks, and coordinating NLP and computer vision tasks. Strong Python skills and hands-on machine learning experience are essential. Competitive hourly compensation ranges from $30 to $50.

Qualifications

• STEM degree or equivalent experience.
• Strong Python and software engineering fundamentals.
• Hands-on ML experience in NLP and/or Computer Vision.
• Familiarity with RLHF, LLM evaluation, and/or prompt evaluation concepts.
• Ability to write clear specs for labeling and QA evaluation processes.

Responsibilities

• Design and ship ML components for LLM training pipelines.
• Partner with data operations to define annotation guidelines and labeling instructions.
• Build and iterate RLHF workflows (ranking, preference data, critique signals).
• Run prompt evaluation and model evaluation to diagnose failure modes.
• Implement QA evaluation checks for annotation guidelines compliance.
• Coordinate NLP tasks and CV annotation.
• Contribute to content safety labeling policies and sampling strategies.
• Track improvements via offline metrics, error analysis, and dataset/versioning practices.

Skills

Python

Machine Learning

NLP

Computer Vision

Software Engineering

Education

STEM degree or equivalent experience

Job description

A technology company in the United States is seeking remote, full-time engineers with STEM backgrounds. Candidates will work on AI/ML systems, focusing on building and improving training pipelines for large language models. Responsibilities include designing ML components, collaborating on annotation guidelines and quality checks, and coordinating NLP and computer vision tasks. Strong Python skills and hands-on machine learning experience are essential. Competitive hourly compensation ranges from $30 to $50.