Remote AI Engineer: RLHF & LLM Benchmarking Expert

prolificacademicltd; Stati Uniti; Remoto; USD 91.000 - 129.000; Part-time

Vantaggi offerti da questo lavoro

Remote engagement

Hourly compensation up to $80

Descrizione del lavoro

prolificacademicltd seeks a senior AI/ML engineer to join an expert contributor network supporting research teams training large language models. The role is remote, project-based, and centered around Oklahoma City, US, applying deep technical expertise to shape model behavior.

You will evaluate explanations, audit production ML code, and provide feedback to strengthen RLHF workflows. Expect work on prompts, RLHF, and benchmarking with careful attention to bias and reliability.

Competenze

• BS/MS/PhD in Computer Science, Artificial Intelligence, Robotics, or related quantitative discipline with ML focus.
• Demonstrated experience building, deploying, or fine-tuning ML models in production settings.
• Working command of modern neural architectures (Transformers, CNNs, RNNs) and their optimization techniques.
• Hands-on experience with LLM-specific workflows such as prompt engineering, RLHF, or RAG.
• Capacity to audit complex model logic, identify training data contamination, and reason about algorithmic proofs.
• Meticulous attention to detail for catching subtle errors and biased outputs.

Mansioni

• Evaluate AI-generated explanations of architectures, loss functions, and backpropagation against ground-truth ML concepts.
• Audit production-grade ML code, including training loops, preprocessing pipelines, and evaluation notebooks.
• Provide structured human feedback to strengthen RLHF alignment workflows.
• Stress-test chain-of-thought reasoning and pinpoint where models produce hallucinations, biases, or logical failures.
• Design and run comparative benchmarks aligned to specific technical taxonomies and performance criteria.

Conoscenze

ML production

LLM workflows

Model auditing

Attention to detail

Deep technical expertise

Formazione

BS in CS/AI/Related

MS in CS/AI/Related

PhD in CS/AI/Related

Strumenti

PyTorch

TensorFlow/Keras

Python (NumPy, Pandas, Scikit-learn)

Hugging Face Transformers

Descrizione del lavoro

prolificacademicltd seeks a senior AI/ML engineer to join an expert contributor network supporting research teams training large language models. The role is remote, project-based, and centered around Oklahoma City, US, applying deep technical expertise to shape model behavior.

You will evaluate explanations, audit production ML code, and provide feedback to strengthen RLHF workflows. Expect work on prompts, RLHF, and benchmarking with careful attention to bias and reliability.