Senior AI Engineer — Train & Evaluate LLMs (Remote)

Prolific Academic Ltd; United States; Remote; USD 83,000 - 110,000; Full time

Benefits offered by this job

Competitive pay rates

Flexible hours

Work from home

Job summary

Prolific Academic Ltd is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate the next generation of LLMs with deep technical expertise. You’ll receive a quick 10- to 15-minute test to assess your skills and suitability for AI tasks, and if successful, you’ll be invited to join Prolific as a participant to get paid for your work.

Researchers looking for your skills tend to pay up to $80 per hour.

Qualifications

• Education: BS/MS/PhD in Computer Science, AI, Robotics or related field with ML focus.
• Experience: building, deploying, or fine-tuning ML models in production.
• Deep learning: understanding of Transformers, CNNs, RNNs and optimizers.

Responsibilities

• Evaluate LLM architecture logic and technical accuracy of explanations.
• Audit ML code, notebooks, data preprocessing scripts, and model evaluations.
• Refine RLHF frameworks and provide high-quality human feedback to align models with intent, safety, and usefulness.
• Analyze model reasoning and identify breakdowns in chain-of-thought prompts.
• Benchmark performance across model outputs using defined metrics and taxonomies.

Skills

ML model deployment

LLM specialization

Deep learning mastery

Prompt engineering

Code auditing

CoT analysis

Education

BS/MS/PhD in CS/AI/Robotics

Tools

PyTorch

TensorFlow/Keras

Python (NumPy/Pandas/Scikit-learn)

Hugging Face Transformers

AWS SageMaker

Google Vertex AI

Weights & Biases

LangChain

Pinecone

Milvus

Weaviate

Job description

Prolific Academic Ltd is seeking AI & Machine Learning Engineers to join our Expert Network to train and evaluate the next generation of LLMs with deep technical expertise. You’ll receive a quick 10- to 15-minute test to assess your skills and suitability for AI tasks, and if successful, you’ll be invited to join Prolific as a participant to get paid for your work.

Researchers looking for your skills tend to pay up to $80 per hour.