Staff Data Engineer - Build Real-Time AI Data Platform

Harbor-Compliance; United States; Remote; USD 172,000 - 215,000; Full time

Benefits offered by this job

Health benefits

Flexible PTO

Parental leave

Fertility and adoption assistance

401(k)

Educational reimbursement

Job summary

Harbor Compliance is building its first end-to-end data platform to unify data from HubSpot, financial systems, and HRIS into a single AI-ready source of truth. As Staff Data Engineer, you will design and build real-time data pipelines, vector DB infrastructure, and ELT/ETL workflows from the ground up, partnering with cross-functional teams to deliver trusted data products.

You will own reliability, governance, and analytics-ready datasets for metrics like ARR, CAC, and churn, while enabling

Qualifications

• 7+ years of hands-on data engineering experience with streaming/event-driven systems.
• Proven experience designing and building near real-time pipelines from scratch (Kafka, Kinesis, Flink, Debezium/CDC) in production.
• Hands-on production experience with vector databases and embeddings (e.g., Pinecone, Weaviate, pgvector, Milvus).
• Advanced proficiency in SQL and Python.
• Working knowledge of cloud data warehouses/lakehouses (Snowflake, BigQuery, Databricks) and dbt.
• Proven experience building end-to-end production data environments, ideally as an early/founding data hire.
• Familiarity with B2B SaaS and recurring revenue data models.
• Working knowledge of BI tools (Looker, Tableau, Power BI).
• Ability to drive multi-stakeholder projects in a lean, fast-moving environment.

Responsibilities

• Design, build, and own near real-time data pipelines as the backbone of the platform.
• Evaluate, implement, and maintain vector database infrastructure and embedding pipelines for AI use cases.
• Design and build ELT/ETL pipelines ingesting data from platforms like HubSpot, financial systems, and HRIS.
• Architect underlying warehouse/lakehouse as the system of record beneath streaming and AI infra.
• Build lightweight transformation layers (dbt) to translate raw data into business-ready datasets.
• Own pipeline reliability and observability across streaming and batch pipelines.
• Develop self-service and AI-powered reporting with BI stakeholders.
• Implement data governance and access controls.
• Partner with Finance, Marketing, Customer Success, and Operations to deliver reliable data products.
• Leverage AI-augmented workflows to accelerate development and documentation.

Skills

Event streaming

CDC tooling

Vector databases

Embedding strategies

ELT/ETL tooling

dbt

SQL

Python

Cloud data warehouse

BI tooling

Tools

Kafka

Kinesis

Flink

Debezium/CDC

Job description

Harbor Compliance is building its first end-to-end data platform to unify data from HubSpot, financial systems, and HRIS into a single AI-ready source of truth. As Staff Data Engineer, you will design and build real-time data pipelines, vector DB infrastructure, and ELT/ETL workflows from the ground up, partnering with cross-functional teams to deliver trusted data products.

You will own reliability, governance, and analytics-ready datasets for metrics like ARR, CAC, and churn, while enabling