Staff Data Engineer - Real-Time AI Data Platform

Harbor Compliance; Northern (KY); Hybrid; USD 172,000 - 215,000; Full time

Job summary

Harbor Compliance is building its first end-to-end data platform to unify fragmented data for executive decision-making. As Staff Data Engineer, you will design and own near real-time pipelines, vector embeddings, and the data warehouse. This foundational role partners with the Sr.

Director of Data Platform & Analytics to enable AI-ready data infrastructure. You will build from the ground up, not maintain existing systems, and drive multi-stakeholder initiatives across Finance, Marketing,

Qualifications

• 7+ years of hands-on data engineering experience.
• Proven design/build of near real-time pipelines from scratch (Kafka/Kinesis/Flink).
• Hands-on production experience with vector databases and embeddings.
• Advanced proficiency in SQL and Python.
• Working knowledge of a cloud warehouse/lakehouse (Snowflake/BigQuery/Databricks) and dbt.

Responsibilities

• Design, build, and own near real-time data pipelines as the backbone of the platform.
• Evaluate and maintain vector DB infrastructure and embedding pipelines for AI-augmented use cases.
• Build ELT/ETL pipelines from platforms like HubSpot, financial systems, and HRIS.
• Architect warehouse/lakehouse as the system of record for streaming and AI infrastructure.
• Create lightweight transformations with dbt to deliver business-ready datasets.

Skills

Streaming pipelines

Vector databases

SQL

Python

Cloud lakehouse

dbt

Tools

Kafka

Kinesis

Flink

Debezium

Zilliz

Pinecone

Weaviate

pgvector

Milvus

Job description

Harbor Compliance is building its first end-to-end data platform to unify fragmented data for executive decision-making. As Staff Data Engineer, you will design and own near real-time pipelines, vector embeddings, and the data warehouse. This foundational role partners with the Sr.

Director of Data Platform & Analytics to enable AI-ready data infrastructure. You will build from the ground up, not maintain existing systems, and drive multi-stakeholder initiatives across Finance, Marketing,