Data Engineer

HeadsUp AI; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

HeadsUp AI is seeking a seasoned Data Engineer (senior-level and up) to join a remote-first team delivering a next-generation sales tool for product-led-growth companies. You will build and scale data pipelines, ingest millions of events daily, and create reliable APIs shaping product decisions.

You will work closely with founders to understand buyer personas and roadmap, shaping the data platform and culture on the ground floor of a greenfield opportunity.

Qualifications

• Experience building data-heavy systems using Scala/Beam on Dataflow and BigQuery.
• Proficiency in at least one SQL dialect (MySQL, PostgreSQL, SqlServer, Oracle).
• Ability to design scalable data APIs and data pipelines.

Responsibilities

• Lead data engineering work including event ingestion architecture and ML pipelines.
• Build reliable services to ingest millions of events daily and derive insights and alerts.
• Own core data pipelines and scale data processing to tens of millions of users.
• Design scalable, durable APIs and optimize data partitioning and infrastructure for security and latency.
• Implement systems to monitor data quality and consistency across clients.
• Define engineering culture and processes in collaboration with founders.

Skills

Scala

Beam (Scio)

SQL

Data pipelines

Tools

BigQuery

Dataflow

Airflow

Oozie

Segment

Job description

Data EngineerCandidates from all backgrounds should feel free to apply, even if their experience is not exactly what is stated in these job descriptions.

We are a remote-first team with team members in North America, Europe, and APAC.

About the role

We're looking for a seasoned Data Engineer (senior-level and up) to join us to build the next-generation sales tool to serve product-led-growth companies like Notion, Figma and Amplitude.

It's an opportunity to shape culture and influence the product on the ground floor of a greenfield opportunity in a huge market.

What you'll do

Robust Development: Help lead our data engineering work, including event ingestion architecture, data infrastructure, and ML pipeline. You'll need to build reliable services to ingest millions of events daily and process them into insights and alerts.

You'll own the HeadsUp product's core data pipelines and be responsible for scaling up data processing flow to the scale of our clients who have tens of millions of users.

You'll need to design intuitive, durable, and extensible APIs that scale.

You'll direct how data should be partitioned and how infrastructure should be set up, optimizing for security and latency.

You'll implement systems tracking the quality and consistency of data ingested by our clients.

You'll design abstractions that empower others to ship quickly by having a thoughtful and generalizable interface.

Technical Culture

Help define our engineering culture and processes. Question and challenge everything and teach us anything we've missed.

Close Collaboration with Product

Work closely with the founders to deeply understand our buyer and user persona and determine our roadmap.

What we're looking for

Experience building data-heavy systems: We're using Scala with Beam (Scio) on top of Dataflow and BigQuery. We work with data warehouses including BigQuery and others, as well as third-party event sources such as Segment. Proficiency in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle).

Ability to see around corners and design both thoughtfully and quickly: While years of experience don't always correlate with this, we think you'll likely have at least 4 years of experience.

(Preferred) Experience with workflow management tools (Airflow, Oozie, Prefect,