Data Engineer – Real-Time Analytics & Data Lake

beehiiv, Inc.; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary

Stock options

Health, dental, and vision insurance

401(k) employer match

Unlimited PTO (minimum 10 days/yr)

Annual in-person team offsite

Unlimited book budget

Monthly Wellness Days

Job summary

beehiiv is hiring a Data Engineer to build and maintain data models and backend data infrastructure. You will join a cross-functional team spanning Data Modeling, Data Engineering, SRE, DevOps, be integral to the analytics and ML feature stores.

Ideal candidates have 4+ years in data engineering, superb SQL, and hands-on experience with Kafka, Clickhouse, Kubernetes, and AWS. Production deployment of RESTful APIs is expected, with strong collaboration across product engineering.

Qualifications

• 4+ years as a Data Engineer or similar data analytics role with strong SQL.
• Excellent SQL skills and data modeling experience for analytics and ML features.
• Experience with OLAP databases and real-time streaming (Kafka) architectures.
• Hands-on with Kubernetes, AWS, Terraform, and CI/CD tooling.
• Proficient in Go, Python, or Ruby; production RESTful API deployments.

Responsibilities

• Build and maintain Clickhouse data model and aggregations for analytics.
• Design and implement event streaming apps with product engineering.
• Hardening Kafka ecosystem for security, performance and cost.
• Automate schema deployments across Kafka Topics, Avro schemas, and migrations.
• Develop a DataLake for long-term storage, DR, and cost optimization.
• Create streaming ETL tasks; e.g., IP info enrichment.
• Build a global entity resolution system and data enrichment product.
• Develop test environments for third-party integrations and maintain schemaless APIs.

Skills

SQL skills

Data modeling

Event-driven architecture

Restful APIs

Production deployments

Team collaboration

Ambiguity handling

SaaS experience

Education

Bachelor's degree in CS/Engineering or equivalent

Tools

Clickhouse

Kafka / Kafka Connect

Schema Registry

Avro

Go

Python

Ruby

Kubernetes

AWS (S3, EKS, VPC, IAM)

Terraform

CI/CD pipelines

REST APIs

Iceberg or data lake architectures

Job description

beehiiv is hiring a Data Engineer to build and maintain data models and backend data infrastructure. You will join a cross-functional team spanning Data Modeling, Data Engineering, SRE, DevOps, be integral to the analytics and ML feature stores.

Ideal candidates have 4+ years in data engineering, superb SQL, and hands-on experience with Kafka, Clickhouse, Kubernetes, and AWS. Production deployment of RESTful APIs is expected, with strong collaboration across product engineering.