Software Engineer, Large-Scale Data Query Systems

Doist; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

In-person 4 days/week in office

Competitive comp and startup equity

Catered lunches and dinners for SF

Commuter benefit

Team building events & poker nights

Health, vision, and dental coverage

Flexible PTO

Latest Apple equipment

401k plan with match

Job summary

Eventual is seeking a Software Engineer on the Systems team to help build the Daft distributed data engine, contributing to core architectural design and implementation of key components.

You will work in a small, autonomous team in our San Francisco Mission district office, four days a week in person, with competitive compensation and startup equity, plus catered lunches, a commuter plan, and strong health benefits.

Qualifications

• Strong foundation in systems programming and distributed data systems.
• Experience with building or operating distributed data engines or databases.
• Proficiency in C/C++ and/or Rust; comfortable in Linux environments.
• Familiarity with cloud platforms (e.g., AWS) and data lake technologies.

Responsibilities

• Planning/Query Optimizer: refine workloads with modern database techniques.
• Execution Engine: enhance memory stability and efficient data processing.
• Distributed Scheduler: improve resource utilization, scheduling and fault tolerance.
• Storage: integrate with Parquet, Iceberg, and Delta Lake in Daft.

Skills

Distributed systems

Systems programming

C/C++

Rust

Linux

Cloud AWS

Autonomy

Tools

Parquet

Iceberg

Delta Lake

Job description

About EventualEvery breakthrough Physical AI system — humanoid robots, autonomous vehicles, video generation models — is trained on petabytes of video, lidar, radar, and sensor data. But today's data platforms (Databricks, Snowflake) were built for spreadsheet‑like analytics, not the multimodal corpora that power AI. Robotics and video‑AI teams now lose 20‑40% of their training time to dataloading alone. GPU bandwidth has grown 2‑3× per generation. Storage and pipelines haven't. The gap widens every year. Eventual was founded in 2022 to close it. Our open‑source engine, Daft, is the distributed data engine purpose‑built for multimodal AI — already running 2 PB/day at Amazon, 60‑100 PB at another FAANG company, and in production at Mobileye, TogetherAI, and CloudKitchens. We are building a video‑native index on top of our engine for Physical AI that streams curated datasets to GPUs at line rate. Saturates B200s today. Aimed at NVL72 and Vera Rubin tomorrow. We're building this in partnership with the top PhysicalAI labs and public AI infrastructure companies today. We have raised $30M from Felicis, CRV, Microsoft M12, Citi, Essence, Y Combinator, Caffeinated Capital, Array.vc, and angels from the co‑founders of Databricks and Perplexity. We've assembled a world‑class team from AWS, Render, Pinecone and Tesla. We have spent our careers powering the last generation of PhysicalAI in self-driving, and are excited to now do this for the next. We are a small (but powerful!) team working together 4 days/week in our SF Mission district office.

Your Role:

As a Software Engineer on the Systems team, you will build key capabilities for the Daft distributed data engine. You will be working on core architectural design and implementation of various components in Daft. While we are an experienced team that can provide constant guidance and mentorship, we value engineers who can autonomously scope and solve difficult technical challenges.

Key Responsibilities:

• Planning/Query Optimizer : intelligently optimize users’ workloads with modern database techniques
• Execution Engine : improve memory stability through the use of streaming computation and more efficient data structures
• Distributed Scheduler : improve Daft’s resource utilization, task scheduling and fault tolerance
• Storage : improve Daft integrations with modern data lake technologies such as Apache Parquet, Apache Iceberg and Delta Lake

What we look for:

• We are looking for a candidate with a strong foundation in systems programming and ideally experience with building distributed data systems or databases (e.g. Hadoop, Spark, Dask, Ray, BigQuery, PostgreSQL etc)
• 3+ years of experience working with distributed data systems (query planning, optimizations, workload pipelining, scheduling, networking, fault tolerance etc)
• Strong fundamentals in systems programming (e.g. C++, Rust, C) and Linux
• Familiarity and experience with cloud technologies (e.g. AWS S3 etc)
• Most importantly, we are looking for someone who works well in small, focused teams with fast iterations and lots of autonomy. If you are passionate, intellectually curious and excited to build the next generation of distributed data technologies, we want you on the team!

Perks & Benefits

• In-person tight knit team with 4x a week in office
• Competitive comp and startup equity
• Catered lunches and dinners for SF employees
• Commuter benefit
• Team building events & poker nights
• Health, vision, and dental coverage
• Flexible PTO
• Latest Apple equipment
• 401k plan with match!