AI Engineer/ML Engineer - Senior Developers - AI Training - San Jose, USA

prolificacademicltd; United States; Remote; USD 91,000 - 129,000; Full time

Benefits offered by this job

Remote work

Job summary

Prolific Academic Ltd is seeking a senior AI/ML engineer to join its expert contributor network. Remote, project-based work supporting research teams in evaluating and improving large language models, focusing on reasoning, coding, and alignment with human intent.

You will audit model behavior, review training pipelines, and contribute high-quality feedback for RLHF frameworks. Strong background in neural architectures and production ML, plus hands-on experience with PyTorch/TensorFlow and LLM

Qualifications

• BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with an ML emphasis.
• Practical experience building, deploying, or fine-tuning ML models in production environments.
• Strong grasp of neural architectures (Transformers, CNNs, RNNs) and contemporary optimization techniques.
• Hands‑on experience with LLM‑specialized workflows such as prompt engineering, RLHF, or RAG.
• Ability to audit complex model behaviour, spot training data contamination, and evaluate the mathematical underpinnings of ML algorithms.
• Meticulous attention to detail when reviewing AI outputs for hallucinations, bias, and logical gaps.

Responsibilities

• Scrutinize AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops, data preprocessing scripts, and evaluation logic, for efficiency and correctness.
• Supply high-quality human feedback that shapes RLHF frameworks and overall model alignment.
• Stress-test chain-of-thought behaviour, identifying where reasoning, accuracy, or safety breaks down.
• Run comparative benchmarks across model outputs using defined taxonomies and performance metrics.

Skills

ML in production

Neural architectures

RLHF workflows

Prompt engineering

Model auditing

Bias analysis

Safety review

Education

PhD in CS/AI or related

MS in CS/AI

BS in CS/AI

Tools

PyTorch

TensorFlow

Hugging Face

AWS SageMaker

Vertex AI

Weights & Biases

LangChain

Pinecone

Job description

Role overview

Operate as a senior AI/ML engineer within an expert contributor network that supplies research teams with rigorous technical judgement for training and evaluating large language models. The work is remote and project-based in the San Jose, USA region, aimed at improving how models reason, code, and align with human intent.

Responsibilities

• Scrutinize AI-generated explanations of model architectures, loss functions, and backpropagation for technical accuracy.
• Audit ML code and notebooks, including training loops, data preprocessing scripts, and evaluation logic, for efficiency and correctness.
• Supply high-quality human feedback that shapes RLHF frameworks and overall model alignment.
• Stress-test chain-of-thought behaviour, identifying where reasoning, accuracy, or safety breaks down.
• Run comparative benchmarks across model outputs using defined taxonomies and performance metrics.

Requirements

• BS, MS, or PhD in Computer Science, Artificial Intelligence, Robotics, or a related quantitative field with an ML emphasis.
• Practical experience building, deploying, or fine-tuning ML models in production environments.
• Strong grasp of neural architectures (Transformers, CNNs, RNNs) and contemporary optimization techniques.
• Hands‑on experience with LLM‑specialized workflows such as prompt engineering, RLHF, or RAG.
• Ability to audit complex model behaviour, spot training data contamination, and evaluate the mathematical underpinnings of ML algorithms.
• Meticulous attention to detail when reviewing AI outputs for hallucinations, bias, and logical gaps.

Nice to have

• Deep proficiency in PyTorch or TensorFlow/Keras, advanced Python (NumPy, Pandas, Scikit-learn), and Hugging Face Transformers.
• Familiarity with AWS SageMaker, Google Vertex AI, and tools like Weights & Biases, LangChain, Pinecone, Milvus, or Weaviate.

Benefits and work setup

• Remote, flexible contributor arrangement with hourly pay commonly reaching up to $80 per hour for this skill profile.
• Tasks generally require about an hour of uninterrupted focus, with many running shorter.