Human Data Engineer & Evaluation Specialist

Pantera Capital

Palo Alto (CA)

On-site

USD 100,000 - 186,000

Full time

11 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Medical, vision & dental
401(k) retirement plan
Disability & life insurance
Employee discounts

Job summary

SpaceXAI is hiring to craft high-value data projects and evaluation strategies, sitting at the intersection of model teams and data operations. This hands-on role focuses on training signals, data collection, and multimodal data integration to influence data strategy.

You will partner with engineering and model teams, own end-to-end delivery, and measure data effectiveness using AI agents and existing platforms, while maintaining rigorous data truthfulness and quality.

Qualifications

  • Bachelor's degree, or 4+ years of relevant experience
  • Experience collaborating with cross-functional teams (engineering, research, product, or annotation/operations groups)
  • Demonstrated experience analyzing datasets to identify trends, anomalies, quality issues, or integrity problems

Responsibilities

  • Partner with model and engineering teams to understand needs and translate them into high-value data projects and evaluation strategies.
  • Own end-to-end delivery of critical data and evaluation projects that capture meaningful training signals and support rapid model development.
  • Leverage AI agents and existing platforms to measure data effectiveness and quantify impact (data yield, eval lift, usage).
  • Maintain rigorous data integrity and truthfulness, including validation processes for factual accuracy; prioritize quality over quantity.
  • Research and apply techniques for data collection, annotation, generation, and multimodal integration.
  • Shape Grok's behavior and domain performance through targeted data work; improve annotation workflows using agents and no/low-code approaches where helpful.
  • Manage plans that shape model behavior via data management, optimization, and analysis, including resources and timelines.
  • Act as a liaison between engineering, technical staff, and tutoring / Human Data teams to drive alignment and knowledge sharing.
  • Collaborate with Human Data Ops and stakeholders to scale projects, share learnings, and contribute to demand forecasting; report status, insights, and blockers for rapid decisions.

Skills

Cross-functional collaboration
Data analysis
Dataset quality issues
Truthfulness & validation
Attention to detail

Education

Bachelor's degree or 4+ years experience
Engineering/CS/data analysis STEM degree

Tools

SQL
Data analysis tools

Job description

SpaceXAI is hiring to craft high-value data projects and evaluation strategies, sitting at the intersection of model teams and data operations. This hands-on role focuses on training signals, data collection, and multimodal data integration to influence data strategy.

You will partner with engineering and model teams, own end-to-end delivery, and measure data effectiveness using AI agents and existing platforms, while maintaining rigorous data truthfulness and quality.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Human Data Engineer: Data Quality & Evaluation
Human Data Engineer: Data Quality & Evaluation

Pantera Capital • Palo Alto (CA)

On-site
USD 144,000 - 270,000
AI Data Engineer for Training & Evaluation
AI Data Engineer for Training & Evaluation

Socket.dev • Palo Alto (CA)

On-site
USD 144,000 - 270,000
Equity
Comprehensive medical, vision, anddent
401(k) retirement plan
+3
AI Data Operations Engineer
AI Data Operations Engineer

AI Chopping Block • Palo Alto (CA)

On-site
USD 144,000 - 270,000
Equity
Medical coverage
Vision coverage
+4
AI Data Steward & Evaluation Lead
AI Data Steward & Evaluation Lead

x • Palo Alto (CA), Northern (KY)

Hybrid
USD 100,000 - 186,000
Equity
Medical coverage
Vision coverage
+5
Human Data Engineer
Human Data Engineer

Pantera Capital • Palo Alto (CA)

On-site
USD 144,000 - 270,000
AI Data Engineer: Quality & Evaluation Lead
AI Data Engineer: Quality & Evaluation Lead

SpaceXAI • Palo Alto (CA)

On-site
USD 144,000 - 270,000
Operations Engineer - Human Data
Operations Engineer - Human Data

AI Chopping Block • Palo Alto (CA)

On-site
USD 144,000 - 270,000
Equity
Medical coverage
Vision coverage
+4
Human Data - Engineer
Human Data - Engineer

Socket.dev • Palo Alto (CA)

On-site
USD 144,000 - 270,000
Equity
Comprehensive medical, vision, anddent
401(k) retirement plan
+3
Human Data Manager
Human Data Manager

Pantera Capital • Palo Alto (CA)

On-site
USD 100,000 - 186,000
Equity
Medical, vision & dental
401(k) retirement plan
+2
Human Data Manager
Human Data Manager

AI Chopping Block • Palo Alto (CA), Northern (KY)

Hybrid
USD 100,000 - 186,000
Equity
Health benefits
401(k) plan