Head of Data Engineering

Harnham

San Francisco (CA)

Hybrid

USD 342,000 - 418,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Harnham is hiring a Head of Data Engineering (AI Gaming) in San Francisco, CA, hybrid onsite (1-2 days). You will define the data engineering vision, build and lead a team, and own the pipelines feeding ML models and game experiences.

You’ll partner with ML, research, game design, and product teams to translate player behavior into data-driven improvements. The role requires 8+ years in data engineering with at least 3+ years leading teams, plus hands-on experience with real-time and batch

Qualifications

  • 8+ years in data engineering with 3+ years in leadership
  • Experience building streaming and batch pipelines for high-volume data
  • Strong Python and SQL skills; distributed processing tools like Spark, Flink, or Kafka
  • Experience with Snowflake, Databricks, or BigQuery and orchestration tools like Airflow or Dagster
  • Experience on AWS or GCP with infrastructure as code and Kubernetes
  • Experience supporting ML workloads including feature stores, training data pipelines, and model evaluation data
  • Ability to hire, grow, and lead engineers and collaborate with research and product leadership

Responsibilities

  • Set the data engineering vision and architecture across real-time telemetry, event pipelines, and warehouse/lakehouse layers
  • Build and lead the data engineering team, hiring and mentoring
  • Design and own pipelines for training data, evaluation sets, and feedback loops for ML and generative AI
  • Partner with ML, research, game design, and product teams to turn player behavior into data for models and experiences
  • Establish data quality, observability, governance, and cost standards across the platform
  • Make build-vs-buy decisions on tooling and keep infrastructure reliable as volume grows

Skills

Data engineering leadership
Team building
Python
SQL
Streaming pipelines
Batch pipelines

Tools

Snowflake
Databricks
BigQuery
Airflow
Dagster
Kubernetes
Spark
Flink
Kafka

Job description

Title: Head of Data Engineering (AI Gaming)

Location: San Francisco, CA (1-2 days onsite per week)

Compensation: Up to $380,000 base + Equity

We’re partnered with a well-funded, fast-growing AI startup building the next generation of AI-native games. Their products are live with a rapidly expanding player base, and the models behind them are trained and improved on the player data this role will own. With player engagement climbing and the team scaling quickly, they’re hiring a first senior data leader to build the foundation everything else runs on.

This is a role for someone who builds the data platform, not just maintains it. You’ll own the pipelines, infrastructure, and standards that feed both live game experiences and model training, and build a team around them. The scope is wide and the impact is direct.

What You’ll Do
  • Set the data engineering vision and architecture across real-time telemetry, player event pipelines, and the warehouse and lakehouse layers behind them
  • Build and lead the data engineering team, hiring, mentoring, and setting the technical bar
  • Design and own the pipelines that supply training data, evaluation sets, and feedback loops for ML and generative AI models
  • Partner with ML, research, game design, and product teams to turn player behavior into data that improves models and game experiences
  • Establish standards for data quality, observability, governance, and cost across the platform
  • Make the build vs. buy calls on tooling and keep infrastructure reliable as player volume grows
Requirements
  • 8+ years in data engineering, including 3+ years leading teams or owning data platforms end-to-end
  • Track record of building and scaling streaming and batch pipelines handling high-volume event data
  • Deep hands-on experience with Python and SQL, plus distributed processing tools such as Spark, Flink, or Kafka
  • Experience with modern data platforms such as Snowflake, Databricks, or BigQuery, and orchestration tools such as Airflow or Dagster
  • Experience on AWS or GCP with infrastructure as code and Kubernetes
  • Experience supporting ML workloads, including feature stores, training data pipelines, and model evaluation data
  • Ability to hire, grow, and lead engineers, and to work with research and product leaders
Bonus Experience
  • Background in gaming, including live-service games, telemetry, player analytics, or LiveOps data
  • Experience building data for generative AI, such as dataset curation, labeling pipelines, or RLHF and feedback data
  • Familiarity with vector databases, embeddings, and retrieval systems
  • Experience with real-time personalization, matchmaking, or recommendation data
  • Experience with anti-cheat, fraud, or player safety data pipelines

If you want to build the data foundation behind a fast-growing AI gaming company and lead the team that runs it, this is the opportunity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Data Scientist, AI Web Game
Sr. Data Scientist, AI Web Game

7Seventy • United States

Hybrid
USD 96,000 - 117,000
Head of Data Platforms for AI Gaming
Head of Data Platforms for AI Gaming

Harnham • San Francisco (CA)

Hybrid
USD 342,000 - 418,000
Senior Data Scientist (Gaming)
Senior Data Scientist (Gaming)

Bring It On • United States

Remote
GBP 90,000 - 130,000
Data Engineer, Analytics
Data Engineer, Analytics

OpenAI, Inc. • San Francisco (CA)

On-site
USD 230,000 - 385,000
Data Engineer
Data Engineer

OpenAI, Inc. • San Francisco (CA)

On-site
USD 235,000 - 385,000
Relocation assistance
Senior Data Engineer
Senior Data Engineer

Gloo • San Francisco (CA)

Hybrid
USD 150,000 - 250,000
Flexible work schedules
Remote-friendly culture
Unlimited PTO
+2
Senior Manager, Data Engineering
Senior Manager, Data Engineering

palmettocleantech • United States

Remote
USD 180,000 - 230,000
Remote position in the United States
Data Engineer (Remote)
Data Engineer (Remote)

7Seventy Recruiting • United States

Remote
USD 160,000 - 190,000
Remote working environment
Flexible, unlimited PTO
13 paid holidays (NFL/Super Bowl)**
+1
Senior Data Engineer (AI-Native) — Data Layer
Senior Data Engineer (AI-Native) — Data Layer

protonai • United States

Remote
USD 150,000 - 210,000
Lead Engineer - Data Engg & AI
Lead Engineer - Data Engg & AI

Anblicks Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000