Remote AI/ML Engineer — Train & Evaluate LLMs

Prolific; United States; Remote; USD 91,000 - 129,000; Full time

Job summary

Prolific is seeking AI and Machine Learning Engineers to join its Expert Network and help train and evaluate next-generation LLMs. You may complete a brief test to verify suitability, with paid opportunities after selection.

Experts earn competitive hourly pay and can work from home with flexible hours. Responsibilities include evaluating architectures, auditing code, and refining RLHF workflows to align models with human intent and safety.

Qualifications

• BS/MS/PhD in CS/AI/Robotics or related quantitative field with ML focus.
• Experience building, deploying, or fine-tuning ML models in a production environment.
• Deep learning mastery with neural networks (Transformers, CNNs, RNNs) and optimization techniques.
• LLM specialization: Prompt Engineering, RLHF, or RAG workflows.
• Technical rigor: audit complex model logic, data contamination, and proofs behind ML algorithms.
• Analytical critique: identify hallucinations, biases, or logical failures in AI outputs.

Responsibilities

• Evaluate LLM architecture logic for technical accuracy.
• Audit ML code and notebooks for efficiency and correctness.
• Refine RLHF frameworks with high-quality human feedback.
• Analyze model reasoning and identify breakdowns in CoT prompts.
• Benchmark model outputs using technical taxonomies and metrics.

Skills

ML model deployment

Deep learning

Transformers

RLHF/RAG

Prompt engineering

Audit model logic

Data quality

Analytical critique

Education

BS/MS/PhD in CS/AI/Robotics or related field with ML focus

Tools

PyTorch

TensorFlow/Keras

Python (NumPy, Pandas)

Hugging Face Transformers

AWS SageMaker

GCP Vertex AI

Weights & Biases

LangChain

Pinecone/Milvus/Weaviate

Job description

Prolific is seeking AI and Machine Learning Engineers to join its Expert Network and help train and evaluate next-generation LLMs. You may complete a brief test to verify suitability, with paid opportunities after selection.

Experts earn competitive hourly pay and can work from home with flexible hours. Responsibilities include evaluating architectures, auditing code, and refining RLHF workflows to align models with human intent and safety.