Member of Technical Staff, AI Engineering

Handshake

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

6 hours ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Ownership: Equity in a fast-growing
Family Support: Paid parental leave, f
Wellbeing: Medical, dental, and vision
Office: Commuting support, free lunch,
Time Off: Flexible PTO, 15 holidays +

Job summary

Handshake is hiring a Member of Technical Staff to build the data systems that enable frontier model training. San Francisco and Mountain View are preferred, with exceptional candidates in other locations considered.

You will partner with researchers, domain experts, and compliance teams to turn ambiguous questions about data generation, quality, and privacy into robust experiments and scalable pipelines. This is a high-impact, hands-on role.

Qualifications

  • 2–10 years of experience in synthetic/LLM-generated data, post-training evaluation, or privacy-focused data handling.
  • Hands-on individual contributor track record; not a management role.
  • Strong Python skills and scalable software for large, messy datasets.
  • Ability to design systems with tradeoffs around quality, scale, and reuse.

Responsibilities

  • Design and build data systems to improve quality, scale, and safety of frontier model training data.
  • Translate research and compliance needs into clear hypotheses, experiments, and production-grade implementations.
  • Develop data-processing pipelines, evaluation frameworks, and quality-control systems.
  • Iterate quickly from prototype to deployed systems, with insights feeding the roadmap.
  • Collaborate with researchers, domain experts, and compliance teams to ensure high-utility, compliant data.
  • Identify repeatable patterns and productize them into reusable platforms.
  • Elevate technical standards through design judgment, clear communication, and mentorship.

Skills

Python
Data privacy
Data anonymization
LLM data pipelines
Data quality
System design

Tools

SQL
Pandas

Job description

Member of Technical Staff, AI Engineering
Location
Employment Type

Full time

Department

HAI Research

Compensation

For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.

About Handshake

Handshake's mission is to organize expert human knowledge to advance the AI economy. Handshake AI works directly with frontier labs on their most consequential data, evaluation, and post-training challenges, building the systems that turn expert human knowledge into the data and evaluations that make frontier models better.

You will work alongside engineers, researchers, operators, and builders from organizations including Scale AI, Meta, Google, Amazon, xAI, Notion, and Palantir—and help build the systems that make expert human knowledge useful for advancing AI.

About Handshake Labs

Handshake Labs is building external AI products, research platforms, and customer-facing AI systems. We are evolving work that is often custom-built for an individual partner into reusable products and platforms that improve with every deployment.

Our work spans the full post-training loop: designing evaluations and training environments, building high-quality data and feedback systems, running experiments, and turning what works into durable infrastructure. For example, we are developing agents that can analyze long, complex coding-agent sessions in days rather than weeks—with expert review and calibration built into the system.

The Role

We are hiring a Member of Technical Staff to help build the data systems that make frontier model training possible. The data Handshake builds for and acquires on behalf of labs is getting more complex and more sensitive, and this role is responsible for improving how we generate, process, and prepare that data—whether that means building higher-quality synthetic and LLM-generated training data, or making acquired third-party data safe to use by removing personal information while preserving the structure that makes it valuable.

You will partner with researchers, domain experts, legal/compliance stakeholders, and customers to turn ambiguous data questions—about generation, quality, evaluation, or privacy—into experiments, pipelines, and durable products. Early members of the team will have unusual influence over our technical direction, standards, and culture.

Location: San Francisco & Mountain View preferred; open to exceptional candidates in other locations (London, Canada, Bangalore, etc.)

What you’ll do

Design and build systems that improve the quality, scale, and safety of the data Handshake generates and acquires for frontier model training—spanning synthetic data generation and data anonymization/PII removal.

Translate ambiguous research, partner, or compliance needs into clear hypotheses, experiments, evaluation plans, and production-quality implementations.

Build and improve data-processing pipelines, evaluation frameworks, benchmarks, and quality-control systems, whether the goal is generating higher-signal synthetic data or verifying that sensitive data has been properly de-identified.

Run fast, rigorous iteration loops: prototype, evaluate, interpret results, and turn learnings into the next system or product.

Partner directly with researchers, domain experts, and—where relevant—legal and compliance teams to ensure data is both high-utility and responsibly handled.

Identify repeatable patterns across engagements and productize them into reusable software and platforms.

Raise the technical bar through strong design judgment, clear communication, code quality, and mentorship.

What we’re looking for

2–10 years of recent, demonstrated experience in one or more of: synthetic/LLM-generated data, post-training and model-evaluation work, privacy engineering, or data anonymization/de-identification at scale.

A hands-on individual contributor track record—this is not a team-lead or engineering-management role.

Strong Python skills and the ability to write clean, efficient, scalable software for large, messy, real-world datasets.

Sound judgment for reasoning about data quality, risk, and utility—forming hypotheses, choosing meaningful metrics, diagnosing failures, and distinguishing signal from noise.

Experience designing systems—not only implementing specifications—including tradeoffs around quality, scale, reliability, and reuse.

Comfort operating in an ambiguous, fast-moving environment with substantial ownership.

Collaborative, low-ego communication and the ability to work effectively with researchers, engineers, domain experts, and customers.

Especially compelling experience

Building or operating large-scale synthetic or LLM-generated data pipelines for model training.

Building or operating large-scale data de-identification or anonymization systems, ideally involving relational or graph-structured data, with experience preserving referential/relationship integrity after anonymization.

Developing LLM/agent benchmarks, evaluation methodologies, annotation systems, or data-quality frameworks.

Research or applied work on reinforcement learning, alignment, model behavior, synthetic data, or human-in-the-loop systems.

Prior work in a regulated or high-sensitivity data environment (healthcare, finance, HR/people data, government), or experience with re-identification risk assessment and privacy auditing.

Published research, meaningful open-source contributions, or evidence of technical leadership in ML systems, data engineering, or AI research.

Experience productizing research or repeated customer work into robust, reusable platforms.

Work on problems at the center of how frontier AI systems improve, alongside leading labs and domain experts.

Help build an early technical organization where your work shapes the roadmap, standards, and culture.

Move fluidly from research insight to real-world systems, with the resources and customer context to see those systems matter.

Join a company building durable infrastructure for careers in the AI economy.

Handshake delivers benefits that help you feel supported—and thrive at work and in life.

The below benefits are for full-time US employees.

  • Ownership: Equity in a fast-growing company
  • Family Support: Paid parental leave, fertility benefits, parental coaching
  • Wellbeing: Medical, dental, and vision, mental health support, $500 wellness stipend
  • Office: Commuting support, free lunch, and gym in our SF office
  • Time Off: Flexible PTO, 15 holidays + 2 flex days
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, AI Engineering
Member of Technical Staff, AI Engineering

Cacheflow • San Francisco (CA)

On-site
USD 140,000 - 200,000
Equity in a fast-growing company
401(k) match
Parental leave & fertility benefits
+7
Member of Technical Staff, Data AI
Member of Technical Staff, Data AI

Handshake • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
401(k) match
Medical, dental, vision
+3
Member of Technical Staff, Data AI
Member of Technical Staff, Data AI

Apply • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 240,000
Equity ownership
401(k) match
Parental benefits and family support
+1
Member of Technical Staff, Post-Training
Member of Technical Staff, Post-Training

Cacheflow • United States

On-site
USD 150,000 - 190,000
Equity in a fast-growing company
401(k) match
Parental leave
+5
Member of Technical Staff, Post-Training
Member of Technical Staff, Post-Training

Handshake • United States

On-site
USD 200,000 - 350,000
Equity
401(k) match
Parental leave
+8
Member of Technical Staff, Evals
Member of Technical Staff, Evals

Cacheflow • United States

On-site
USD 180,000 - 240,000
Equity
401(k) match
Parental leave
+11
Senior Software Engineer, Coding
Senior Software Engineer, Coding

Handshake • San Francisco (CA)

Hybrid
USD 140,000 - 220,000
Ownership
Financial Wellness
Family Support
+5
Senior Software Engineer, Agentic Infrastructure
Senior Software Engineer, Agentic Infrastructure

Handshake • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
401(k) match
Parental leave
+6
Data Scientist, Handshake AI
Data Scientist, Handshake AI

Handshake • San Francisco (CA)

Hybrid
USD 140,000 - 190,000
Equity
Parental leave
Fertility benefits
+6
Staff Product Designer, Handshake AI
Staff Product Designer, Handshake AI

Handshake • New York (NY)

Hybrid
USD 225,000 - 250,000
Ownership
Financial Wellness
Family Support
+5