Data Quality Engineer for LLM Pre-Training

B Capital; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Top-tier compensation

Comprehensive health and wellness insurance

Fully paid parental leave

Paid time off

Daily meals provided

Job summary

B Capital is seeking a data engineer focused on ensuring high-quality data for AI model training. You will work closely with top researchers to develop metrics and standards for data quality.

The ideal candidate has solid experience in Python and data pipelines and is detail-oriented. Join us to drive significant impacts in the realm of AI innovation within a supportive, mission-driven team.

Qualifications

• Strong engineering fundamentals with experience in data pipelines and QA systems.
• Detail-oriented with an analytical mindset.
• Understanding of data quality impacts on pre-training.
• Experience in designing automated quality checks.
• Ability to work autonomously and collaboratively.

Responsibilities

• Own upstream data quality for LLM pre-training.
• Collaborate with teams to translate quality signals.
• Design and scale automated QA methods.
• Build reusable QA pipelines for data delivery.
• Monitor and improve data quality over time.

Skills

Proficiency in Python

Building ML / LLM workflows

Experience with large datasets

Automated evaluation or quality-checking systems

Excellent communication skills

Job description

B Capital is seeking a data engineer focused on ensuring high-quality data for AI model training. You will work closely with top researchers to develop metrics and standards for data quality.

The ideal candidate has solid experience in Python and data pipelines and is detail-oriented. Join us to drive significant impacts in the realm of AI innovation within a supportive, mission-driven team.