Technical Staff, Data

TieTalent; San Francisco (CA); On-site; USD 61,000 - 83,000; Full time

Job summary

A leading company is seeking a Data Specialist to play a pivotal role in data quality and analysis for training AI models. This position involves designing experiments, developing tools for data workflows, and ensuring high-quality datasets. Ideal candidates will have a strong analytical background, experience in data engineering, and proficiency in coding, particularly with tools such as TypeScript and AWS. Competitive salary and benefits are offered.

Benefits

Opportunity for professional growth

Collaborate with top AI researchers

Competitive compensation

Qualifications

• Proven experience in experiment and protocol design for data collection.
• Strong analytical skills for qualitative and quantitative data analysis.
• Excellent organizational and communication skills.

Responsibilities

• Design experiments and protocols for high-quality data collection.
• Manage projects, including payments and tracking hours for raters.
• Develop and manage data pipelines and human-facing services.

Skills

Data analysis

Experiment design

Coding

Data engineering

Education

Bachelor's degree in relevant field

Tools

TypeScript

JavaScript

Firebase

Go

GCP

AWS

Job description

2 days ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

Role Overview:

Data quality and diversity is one of the single most important factors to training state-of-the-art models. As a member of the technical staff focused on data at Reflection, you will play a pivotal role in shaping how we collect, process, and analyze human and internet data for training AI models. You will design and execute protocols, develop tools and interfaces, and manage data workflows that underpin our RL and SFT efforts. Your work will combine creativity, precision, and technical expertise to ensure our datasets meet the highest quality standards and align with our mission.

About

Role Overview:

Data quality and diversity is one of the single most important factors to training state-of-the-art models. As a member of the technical staff focused on data at Reflection, you will play a pivotal role in shaping how we collect, process, and analyze human and internet data for training AI models. You will design and execute protocols, develop tools and interfaces, and manage data workflows that underpin our RL and SFT efforts. Your work will combine creativity, precision, and technical expertise to ensure our datasets meet the highest quality standards and align with our mission.

Key Responsibilities

• Experiment Design and Data Collection:
• Design experiments, protocols, and user interfaces to collect high-quality human data for training AI models or evaluating AI systems.
• Determine the type of human data needed to optimize model performance.
• Analyze collected data qualitatively and quantitatively, including reviewing PRs, Issues, code reviews, and traces.
• Ensure creativity and communication are integral to the data collection process.
• Human Data Operations:
• Manage projects, including payments and tracking hours for human raters.
• Train and onboard raters, providing clear guidance and technical support.
• Debug technical problems encountered by raters and ensure quality control through regular review of their responses.
• Prioritize attention to detail, organization, and communication in all operations.
• Apply coding skills to annotation tasks, such as code reviews and code generation.
• Data Engineering:
• Design, implement, and optimize data pipelines to support scalable data collection.
• Leverage prompt engineering and integrate LLM solutions to improve processes.
• Develop scalable and asynchronous systems for data operations.
• Human-Facing Data Services:
• Develop and manage human-facing services using tools like TypeScript, JavaScript, and Firebase.
• Build backend services using frameworks like FastAPI or Go.
• Utilize cloud platforms such as GCP and AWS to deploy and maintain services.
  
  

Qualifications

• Proven experience in experiment and protocol design for data collection.
• Strong analytical skills with the ability to conduct both qualitative and quantitative data analysis.
• Excellent organizational and communication skills to manage human data operations effectively.
• Hands-on experience in data engineering, prompt engineering, and integrating LLM solutions.
• Proficiency in coding, particularly in managing human-facing services and annotation tasks.
• Familiarity with tools and platforms like TypeScript, Firebase, FastAPI, GCP, and AWS.
• Background in software engineering, including open-source contributions and code review experience.
• Experience with ML/LLM is a plus.
  
  

What We Offer

• The opportunity to work at the forefront of AI research and data collection for training cutting-edge models.
• Collaboration with a team of world-class researchers and engineers from top AI labs and companies.
• Competitive compensation and benefits, with opportunities for professional growth.
  
  

How to Apply: If our mission and approach inspire you, and you are curious and data obsessed in nature, we want to hear from you. Consider applying to join the data team at Reflection.

Nice-to-have skills

• TypeScript
• JavaScript
• Firebase
• Go
• GCP
• AWS
• Prompt Engineering
• San Francisco, California
  
  

Work experience

• Data Engineer
• Data Infrastructure
  
  

Languages

• English

Seniority level

• Seniority level

  Entry level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Technology, Information and Internet

Referrals increase your chances of interviewing at TieTalent by 2x

Get notified about new Data Specialist jobs in San Francisco, CA.

San Francisco, CA $61,152 - $82,992 1 month ago

South San Francisco, CA $90,000 - $120,000 4 days ago

Analyst Data Analytics - US Based Remote

Data Analyst - People Analytics (Short-Term Employment)

San Francisco, CA
$124,000.00
-
$176,000.00
2 weeks ago

San Francisco, CA
$78,624.00
-
$113,568.00
1 month ago

Alameda, CA
$86,700.00
-
$173,300.00
2 days ago

San Francisco, CA
$90,000.00
-
$250,000.00
12 months ago

San Francisco, CA
$116,480.00
-
$149,760.00
1 month ago

Burlingame, CA
$104,000.00
-
$149,000.00
5 hours ago

2025 SMASH Academy Python for Data-Driven Applications Facilitator (Berkeley)

San Francisco, CA
$146,400.00
-
$219,600.00
2 weeks ago

San Francisco, CA
$120,000.00
-
$140,000.00
2 days ago

San Francisco, CA
$180,000.00
-
$200,000.00
2 weeks ago

San Francisco, CA
$100,600.00
-
$206,300.00
3 days ago

San Francisco, CA $50,000 - $200,000 1 month ago

San Francisco, CA $135,000 - $190,000 5 months ago

San Francisco Bay Area $160,000 - $180,000 2 weeks ago

Alameda, CA $86,700 - $173,300 4 hours ago

San Francisco, CA $178,000 - $195,800 8 months ago

San Francisco, CA $188,000 - $256,000 3 weeks ago

San Francisco, CA $167,300 - $251,000 2 weeks ago

San Francisco, CA $156,000 - $234,000 3 days ago

San Mateo, CA $20,000 - $60,000 1 year ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.