Lead Data Science Manager - LLM Training, Flexible Hours

LexisNexis; San Francisco (CA); On-site; USD 115,000 - 192,000; Full time

Job summary

LexisNexis Legal & Professional is seeking a Manager Data Science in San Francisco to lead a team of data scientists. You will design and oversee LLM training, fine-tuning, and evaluation, while ensuring reproducible development practices and collaboration with product and engineering teams.

You will manage datasets, optimize training workflows, and mentor junior team members to deliver high-quality AI solutions aligned with business needs.

Qualifications

• LLM fundamentals including transformer architectures and training objectives.
• Experience with supervised fine-tuning and objective tuning.
• Knowledge of parameter-efficient fine-tuning and tradeoffs.

Responsibilities

• Lead design and execution of LLM training and fine-tuning projects.
• Oversee high-quality training datasets: collection, cleaning, deduplication, annotation, validation.
• Develop and optimize supervised fine-tuning and PEFT workflows.
• Establish evaluation frameworks for accuracy, safety, and task performance.
• Diagnose training issues and improve model quality and efficiency.
• Mentor data scientists and enforce reproducible development practices.
• Partner with product, engineering and domain experts for deployment needs.
• Prioritize projects, manage timelines and compute resources.

Skills

LLM fundamentals

Python programming

PyTorch

Hugging Face Transformers

SFT (supervised fine-tuning)

PEFT (LoRA/QLoRA)

Data engineering for datasets

GPU & distributed training

Experiment tracking & reproducibility

Model evaluation & debugging

Checkpoint management & versioning

Tools

Python

PyTorch

Hugging Face Transformers

Datasets

PyTorch FSDP

DeepSpeed

LoRA

QLoRA

Job description

LexisNexis Legal & Professional is seeking a Manager Data Science in San Francisco to lead a team of data scientists. You will design and oversee LLM training, fine-tuning, and evaluation, while ensuring reproducible development practices and collaboration with product and engineering teams.

You will manage datasets, optimize training workflows, and mentor junior team members to deliver high-quality AI solutions aligned with business needs.