Remote NLP Data Scientist & LLM Fine-Tuning Specialist

Zoho; United States; Remote; USD 120,000 - 190,000; Part time

Job summary

Fyerx seeks an experienced NLP Data Scientist / LLM Fine-Tuning Specialist to own open-source model optimization tracks. You will drive PEFT-based fine-tuning, curate high-quality datasets, and implement RLHF/DPO to enforce safe, domain-aligned outputs.

Responsibilities include scaling multi-GPU training, model quantization, and collaborating with MLOps for cloud deployment and inference serving. Remote offshore contract role with international scope.

Qualifications

• 4 to 8 years of core data science or advanced ML engineering experience with 3+ years actively training, evaluating, and fine-tuning NLP systems.
• Expert-level mastery of Python, PyTorch, transformers (Hugging Face), and vector calculations.
• Deep understanding of attention mechanisms, tokenization constraints, context window effects, loss optimization, and CUDA hardware.

Responsibilities

• Lead LLM fine-tuning initiatives using PEFT techniques (LoRA, QLoRA, Prefix/Prompt Tuning) on open-source architectures (Llama, Mistral).
• Curate, clean, structure high-quality training datasets with deduping, tokenization schemes, synthetic data pipelines, and human-in-the-loop validation.
• Implement RLHF or DPO to align models with safety, helpfulness, and tone guards.
• Optimize model footprints with post-training quantization (GGUF, AWQ, GPTQ) to reduce compute budgets.
• Design evaluation benchmarks and metrics (BLEU, ROUGE, custom checks) to audit hallucinations and domain alignment.
• Manage distributed DL training jobs across multi-GPU blocks and scale pipelines.
• Collaborate with MLOps to format model weights for cloud deployment and real-time inference serving.

Skills

Python

PyTorch

Transformers

PEFT

RLHF

DPO

CUDA

Tensor Parallelism

Education

Master’s or Ph.D. in CS/DS/Computational Linguistics

Tools

LoRA

QLoRA

Prefix Tuning

Prompt Tuning

GGUF

AWQ

GPTQ

Job description

Fyerx seeks an experienced NLP Data Scientist / LLM Fine-Tuning Specialist to own open-source model optimization tracks. You will drive PEFT-based fine-tuning, curate high-quality datasets, and implement RLHF/DPO to enforce safe, domain-aligned outputs.

Responsibilities include scaling multi-GPU training, model quantization, and collaborating with MLOps for cloud deployment and inference serving. Remote offshore contract role with international scope.