LLM Data Science Manager — Lead & Scale AI Programs

RELX; San Francisco (CA); On-site; USD 115,000 - 192,000; Full time

Job summary

LexisNexis Legal & Professional is seeking a Manager Data Science in San Francisco to lead a team of junior data scientists and champion best-practice development in model workstreams. The role emphasizes mentoring, governance, and collaboration with cross-functional partners to deliver reliable AI solutions.

You will drive LLM training programs, data preparation, evaluation, and optimize fine-tuning workflows, balancing performance with resource efficiency while ensuring reproducibility

Qualifications

• Experience with LLM training and fine-tuning.
• Strong Python and PyTorch skills.
• Experience with PEFT methods (LoRA/QLoRA).

Responsibilities

• Lead design and execution of LLM training and fine-tuning projects, including model selection, training strategy, experimentation, and evaluation.
• Oversee the preparation of high-quality training datasets, including data collection, cleaning, deduplication, annotation, and quality validation.
• Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows; apply preference optimization methods where appropriate.
• Establish evaluation frameworks to assess factual accuracy, instruction following, domain relevance, safety, and performance on business-specific tasks.
• Diagnose training issues and improve model quality, training stability, GPU utilization, and computational efficiency.
• Manage and mentor data scientists, review technical work, and establish reproducible development practices.
• Partner with product, engineering, and domain experts to define requirements and support model deployment and monitoring.
• Manage project priorities, timelines, and compute resources, and communicate results and tradeoffs to stakeholders.

Skills

Python

PyTorch

Hugging Face

LLM training

PEFT LoRA/QLoRA

Data engineering

GPU training

Tools

PyTorch

Hugging Face

Job description

LexisNexis Legal & Professional is seeking a Manager Data Science in San Francisco to lead a team of junior data scientists and champion best-practice development in model workstreams. The role emphasizes mentoring, governance, and collaboration with cross-functional partners to deliver reliable AI solutions.

You will drive LLM training programs, data preparation, evaluation, and optimize fine-tuning workflows, balancing performance with resource efficiency while ensuring reproducibility