Manager Data Science**Home based San Francisco, CA

Relx Plc

San Francisco (CA)

Vor Ort

USD 115.000 - 192.000

Vollzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Wellbeing initiatives
Parental leave
Study assistance
Sabbaticals

Zusammenfassung

LexisNexis Legal & Professional is seeking a Manager Data Science in San Francisco to lead a team focused on LLM training and fine-tuning, collaborating with product, engineering, and domain experts to drive business-ready AI solutions.

The role emphasizes mentorship, reproducible workflows, and innovation in model development, evaluation, and deployment within a fast-paced setting. A strong emphasis on responsible AI practices and performance optimization is expected.

Qualifikationen

  • Strong understanding of transformer architectures and language modeling objectives.
  • Experience with supervised fine-tuning (SFT) and loss masking.
  • Hands-on experience with PEFT methods like LoRA/QLoRA.
  • Ability to build instruction-response datasets and manage data leakage risk.

Aufgaben

  • Lead the design and execution of LLM training and fine-tuning projects.
  • Oversee creation of high-quality training datasets with cleaning, deduplication, annotation, and validation.
  • Develop efficient fine-tuning workflows and evaluation frameworks.
  • Mentor data scientists and ensure reproducible development practices.
  • Collaborate with product, engineering, and domain experts to deploy and monitor models.

Kenntnisse

LLM fundamentals
Python
PyTorch
Hugging Face Transformers
SFT
PEFT
Data engineering
GPU training
Experiment tracking
Reproducibility

Tools

DeepSpeed
PyTorch FSDP

Jobbeschreibung

**About the Business** LexisNexis Legal & Professional provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis and Nexis services. **About the Role** A Manager Data Science is an emerging subject matter expert in their domain. They lead a team of junior members to support their development and work product. They are mindful of best practices and train their team in the execution of those best practices. They manage a team to define new best practices and innovative approaches to new business problems or use cases.**Responsibilit**ies * Lead the design and execution of LLM training and fine-tuning projects, including model selection, training strategy, experimentation, and evaluation.* Oversee the preparation of high-quality training datasets, including data collection, cleaning, deduplication, annotation, and quality validation.* Develop and optimize supervised fine-tuning and parameter-efficient fine-tuning workflows; apply preference optimization methods where appropriate.* Establish evaluation frameworks to assess factual accuracy, instruction following, domain relevance, safety, and performance on business-specific tasks.* Diagnose training issues and improve model quality, training stability, GPU utilization, and computational efficiency.* Manage and mentor data scientists, review technical work, and establish reproducible development practices.* Partner with product, engineering, and domain experts to define requirements and support model deployment and monitoring.* Manage project priorities, timelines, and compute resources, and communicate results and tradeoffs to stakeholders. **Requirements** * **LLM fundamentals:** Strong understanding of transformer architectures, attention mechanisms, tokenization, language modeling objectives, and the differences between pretraining, continued pretraining, and fine-tuning.* **Programming and frameworks:** Strong Python and PyTorch skills, with practical experience using Hugging Face Transformers, Datasets, or equivalent tools.* **Hands-on LLM training:** Demonstrated ability to implement supervised fine-tuning (SFT), configure training objectives and loss masking, tune hyperparameters, and select model checkpoints.* **Efficient fine-tuning:** Practical experience with parameter-efficient fine-tuning (PEFT), including LoRA or QLoRA, and an understanding of their quality, memory, and compute tradeoffs.* **Training data engineering:** Ability to build instruction-response datasets, apply chat templates, manage sequence lengths and packing, and prevent data leakage and evaluation contamination.* **GPU and distributed training:** Experience training models across multiple GPUs using frameworks such as PyTorch FSDP or DeepSpeed, including mixed precision, gradient accumulation, and gradient checkpointing.* **Evaluation and debugging:** Ability to design reliable benchmarks and human evaluations, analyze model errors, and troubleshoot unstable loss, overfitting, and GPU memory issues.* **Reproducibility:** Experience with experiment tracking, dataset and model versioning, checkpoint management, and documented training pipelines. **Work in a Way That Works for You** We promote a healthy work/life balance across the organisation. We offer an appealing working prospect for our people. With numerous wellbeing initiatives, shared parental leave, study assistance and sabbaticals, we will help you meet your immediate responsibilities and your long-term goals. **Working Pattern** Working flexible hours - flexing the times when you work in the day to help you fit everything in and work when you are the most product**ive.****About the Business** LexisNexis Legal & Professional provides legal, regulatory, and business information and analytics that help customers increase their productivity, improve decision-making, achieve better outcomes, and advance the rule of law around the world. As a digital pioneer, the company was the first to bring legal and business information online with its Lexis and Nexis services. U.S. National Base Pay Range: $115,400 - $192,300. Geographic differentials may apply in some locations to better reflect local market rates.This job is eligible for an annual incentive bonus.
Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Manager Data Science**Home based San Francisco, CA
Manager Data Science**Home based San Francisco, CA

Relx Plc • San Francisco (CA)

Vor Ort
USD 115.000 - 192.000
Manager Data Science*Home Based San Francisco, Ca
Manager Data Science*Home Based San Francisco, Ca

Lexisnexis Legal & Professional® • California

Vor Ort
USD 115.000 - 192.000
Annual incentive bonus
Country-specific benefits
Manager Data Science*Home based San Francisco, CA
Manager Data Science*Home based San Francisco, CA

RELX Inc. Company • San Francisco (CA)

Hybrid
USD 115.000 - 192.000
Annual incentive bonus
Country-specific benefits
Wellbeing initiatives
+3
Lead Data Scientist
Lead Data Scientist

RELX International • Raleigh (NC)

Vor Ort
USD 105.000 - 175.000
Lead Data Scientist
Lead Data Scientist

LexisNexis Legal & Professional • Raleigh (NC)

Vor Ort
USD 105.000 - 175.000
Vision insurance
Performance bonus
Manager, AI & LLM Data Science
Manager, AI & LLM Data Science

Relx Plc • San Francisco (CA)

Vor Ort
USD 115.000 - 192.000
Wellbeing initiatives
Parental leave
Study assistance
+1
LLM Data Science Manager — AI Model Training Lead
LLM Data Science Manager — AI Model Training Lead

Lexisnexis Legal & Professional® • California

Vor Ort
USD 115.000 - 192.000
Annual incentive bonus
Country-specific benefits
Senior Data Scientist III
Senior Data Scientist III

LexisNexis • Raleigh (NC)

Vor Ort
USD 115.400 - 192.300
Health Benefits
401(k) Retirement
Wellbeing programs
+4
LLM Data Science Manager — Lead & Scale AI Programs
LLM Data Science Manager — Lead & Scale AI Programs

Relx Plc • San Francisco (CA)

Vor Ort
USD 115.000 - 192.000
Manager Data Science
Manager Data Science

LexisNexis Legal & Professional • Raleigh (NC)

Vor Ort
USD 170.000 - 230.000
Wellbeing initiatives
Shared parental leave
Study assistance
+1