LLM Dataset Engineer: Lead Data Strategy & Scale

Sciforium; San Francisco (CA); On-site; USD 155,000 - 210,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k plan

Daily lunch, snacks, and beverages

Flexible time off

Competitive salary and equity

Job summary

Sciforium is looking for a visionary LLM Dataset Engineer to own the strategy and creation of datasets for next-generation AI models. The role focuses on the end-to-end data lifecycle, ensuring model excellence through innovative data practices and advanced engineering skills.

Applicants should possess over 5 years of experience in data science or machine learning, with a strong background in Python and handling large datasets. Benefits include competitive salary, insurance, and flexible time off.

Qualifications

• 5+ years of industry experience in data science or machine learning.
• Expert-level proficiency in Python focusing on performance.
• Experience working with petabyte-scale datasets.

Responsibilities

• Own the end-to-end creation of pre-training datasets for LLMs.
• Design and implement pipelines for data cleaning and deduplication.
• Lead development of high-quality post-training datasets.

Skills

Data Science or Machine Learning

High-performance Python coding

Petabyte-scale datasets handling

Dataset building from scratch

Education

Master’s or PhD in a quantitative field

Tools

Spark

Ray

Job description

Sciforium is looking for a visionary LLM Dataset Engineer to own the strategy and creation of datasets for next-generation AI models. The role focuses on the end-to-end data lifecycle, ensuring model excellence through innovative data practices and advanced engineering skills.

Applicants should possess over 5 years of experience in data science or machine learning, with a strong background in Python and handling large datasets. Benefits include competitive salary, insurance, and flexible time off.