Lead Data Platform Engineer — Hybrid, Equity Eligible

Eightfold; Santa Clara (CA); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Eightfold is seeking a Lead Engineer for the Data Platform team to architect and build large-scale data infrastructure powering AI and Talent Intelligence.

You will own the design of real-time and batch data pipelines, drive reliability and observability, and partner with AI/ML and product teams to enable fast, reliable data access. A high-impact leadership role with global reach and hybrid work expectations.

Qualifications

• 7+ years of experience in distributed systems engineering.
• Strong programming skills in Java, Scala, Python, or Go.
• Experience with Spark, Kafka, Airflow, Flink, or Snowflake.
• Strong understanding of distributed systems, cloud infrastructure, and large-scale data processing.
• Experience operating production systems on AWS or similar cloud platforms.

Responsibilities

• Lead the design and development of scalable data platform services and distributed data systems.
• Build and optimize batch and real-time data pipelines and platform tooling.
• Drive best practices around reliability, observability, CI/CD, and infrastructure automation.
• Partner with AI/ML, analytics, and product engineering teams to enable efficient and reliable data access.
• Mentor engineers and contribute to long-term platform architecture and technical strategy.

Skills

Distributed systems

Programming: Java/Scala/Python/Go

Spark

Kafka

Airflow

Flink

Snowflake

AWS

Tools

AWS

Job description

Eightfold is seeking a Lead Engineer for the Data Platform team to architect and build large-scale data infrastructure powering AI and Talent Intelligence.

You will own the design of real-time and batch data pipelines, drive reliability and observability, and partner with AI/ML and product teams to enable fast, reliable data access. A high-impact leadership role with global reach and hybrid work expectations.