Senior AI Engineer - Remote ML Alignment & Evaluation

prolificacademicltd; United States; Remote; USD 83,000 - 110,000; Full time

Benefits offered by this job

Fully remote

Flexible hours

Fast onboarding

Job summary

prolificacademic ltd is seeking a senior AI/ML engineer for a contract role focused on training and evaluating large language models. Work consists of one-hour focused sessions within an expert contributor network, with researchers paying up to $80 per hour.

An initial 10–15 minute skills assessment gates entry, ensuring high standards of expertise. Responsibilities include reviewing explanations of architectures and loss functions, auditing training code and notebooks for efficiency, and

Qualifications

• Bachelor's/Master's/PhD with ML focus in CS/AI related field.
• Hands-on experience building, deploying, or fine-tuning ML models.
• Hands-on with neural architectures like Transformers, CNNs, RNNs.
• Experience with prompt engineering, RAG, or RLHF.
• Ability to audit model logic and detect data contamination.

Responsibilities

• Review explanations of model architectures and loss functions for accuracy.
• Audit ML code, training loops, and evaluation pipelines for efficiency.
• Provide high-quality feedback for RLHF-aligned models.
• Assess chain-of-thought prompts and detect reasoning failures.
• Run benchmarking against defined metrics and taxonomies.

Skills

Transformers

Neural networks

Prompt engineering

RLHF

PyTorch

TensorFlow

Python

Model evaluation

Audit ML code

ML deployment

Education

PhD in CS/AI/related quantitative discipline

Masters in related field

Bachelor's in CS/AI/related field

Tools

PyTorch

TensorFlow/Keras

Hugging Face Transformers

AWS SageMaker

GCP Vertex AI

Weaviate / Pinecone

Job description

prolificacademic ltd is seeking a senior AI/ML engineer for a contract role focused on training and evaluating large language models. Work consists of one-hour focused sessions within an expert contributor network, with researchers paying up to $80 per hour.

An initial 10–15 minute skills assessment gates entry, ensuring high standards of expertise. Responsibilities include reviewing explanations of architectures and loss functions, auditing training code and notebooks for efficiency, and