Lead Data Engineer

Zexter

United States

Teletrabalho

USD 140 000 - 210 000

Tempo integral

14 dias+

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Fully remote work
Competitive salary

Resumo da oferta

Zexter is seeking a data engineering lead to design and roll out a multi-tenant Lakehouse that turns streaming and batch data into reliable analytics for business clients. You will own the architecture from Kafka ingestion through ClickHouse data marts with tenant isolation, access controls, and repeatable onboarding built into the platform.

Responsibilities include enforcing tenant separation, building ingestion and stream processing, developing dbt transformations, and orchestrating pipelines

Qualificações

  • 6+ years of data engineering experience, including data warehouses or lakes.
  • Advanced SQL and Python skills; practical experience with Kafka, stream processing, Airflow and ClickHouse.
  • Experience building multi-tenant or B2B analytics systems with tenant-aware models and access controls.
  • Knowledge of Lakehouse SQL engines and data modeling across raw, staging, and mart layers.
  • Understanding of row-level security, RBAC, and access auditing.
  • Experience with data CI/CD, testing, version control, and documentation, plus owning architecture and delivery.

Responsabilidades

  • Design the Lakehouse and enforce tenant separation across storage, catalogs, models, and serving layers.
  • Build Kafka ingestion and stream processing for activity, transactions, promotions, and partner feeds.
  • Develop batch and ELT transformations in dbt; orchestrate pipelines in Airflow including tenant onboarding.
  • Create ClickHouse data marts for responsive analytics and optimize query performance and cost.
  • Set up tenant-aware roles, access auditing, data quality checks, monitoring, alerts, and documentation.
  • Collaborate with analytics, BI, and product teams to shape raw data into client-facing datasets and guide tooling decisions.

Conhecimentos

Advanced SQL
Python
Kafka
Airflow
ClickHouse
Data modeling
Multi-tenant analytics
Data CI/CD
Documentation

Ferramentas

dbt
Elasticsearch
Terraform
Docker
Kubernetes

Descrição da oferta de emprego

Role overview

Lead the design and production rollout of a multi-tenant Lakehouse that turns streaming and batch data into reliable analytics for business clients. You'll own the architecture from Kafka ingestion through ClickHouse data marts, with tenant isolation, access controls, and repeatable onboarding built into the platform.

Responsibilities
  • Design the Lakehouse and enforce tenant separation across storage, catalogs, models, and serving layers.
  • Build Kafka ingestion and stream processing for product activity, transactions, betting activity, promotions, and partner feeds.
  • Develop batch and ELT transformations in dbt, and orchestrate pipelines in Airflow, including workflows for adding tenants.
  • Create ClickHouse data marts for responsive analytics and BI, and improve query performance and cost as usage grows.
  • Set up tenant-aware roles, access auditing, data quality checks, monitoring, alerts, and technical documentation.
  • Work with analytics, BI, and product colleagues to shape raw data into dependable client-facing datasets and guide architecture and tooling decisions.
Requirements
  • At least six years of data engineering experience, including designing data warehouses or lakes.
  • Advanced SQL and strong Python skills; practical experience with Kafka and stream processing, Airflow, and ClickHouse.
  • Experience building multi-tenant or B2B analytics systems, including tenant-aware models, data isolation, and access controls.
  • Knowledge of Lakehouse SQL engines and data modeling across raw, staging, and mart layers, including dimensional models, slowly changing dimensions, incremental loads, and tenant partitioning.
  • Understanding of row-level security, role-based access, and access auditing.
  • Experience with data CI/CD, testing, version control, and documentation, plus the ability to own architecture and delivery independently.
Nice to have
  • Experience in betting or iGaming, or familiarity with metrics such as GGR, NGR, LTV, RTP, retention, and conversion funnels.
  • Experience with Elasticsearch, Terraform, Docker, Kubernetes, BI tools, or self-service analytics for external clients.
  • Background in cloud cost optimization, tenant onboarding, or templated pipelines.
Benefits and work setup
  • Fully remote work and a competitive salary.
  • Opportunity to influence product quality directly, with low bureaucracy and collaboration across development and product teams.
  • Career growth opportunities and technically varied work.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Remote Lead Data Engineer - Multi-Tenant Lakehouse
Remote Lead Data Engineer - Multi-Tenant Lakehouse

Zexter • EUA

Teletrabalho
USD 140 000 - 210 000
Fully remote work
Competitive salary
Software Engineer, Data Platform – Financial Data Lakehouse
Software Engineer, Data Platform – Financial Data Lakehouse

MaxIT Consulting - Max Corporate Group • New York (NY)

Presencial
USD 120 000 - 160 000
Data Platform Engineer
Data Platform Engineer

ClickHouse • EUA

Teletrabalho
USD 150 000 - 230 000
Flexible work environment
Healthcare contributions
Equity in the company
+2
Senior Data Engineer
Senior Data Engineer

Ethereum Technologies LLC • Atlanta (GA)

Presencial
USD 120 000 - 180 000
Senior Data Engineer
Senior Data Engineer

CIS Technologies INC • EUA

Teletrabalho
USD 120 000 - 160 000
Senior Data Engineer
Senior Data Engineer

Quantum Technologies LLC • Atlanta (GA)

Presencial
USD 120 000 - 180 000
Senior Data Engineer
Senior Data Engineer

Robotic Process Automation LLC • Atlanta (GA)

Presencial
USD 120 000 - 180 000
Senior Data Engineer
Senior Data Engineer

Valiant Technologies LLC • Atlanta (GA)

Presencial
USD 120 000 - 180 000
Lead Data Engineer (Lakehouse / Databricks)
Lead Data Engineer (Lakehouse / Databricks)

Stafford Gray • Town of Lansing (NY)

Híbrido
USD 130 000 - 180 000
Senior Data Engineer
Senior Data Engineer

The Modulae • EUA

Teletrabalho
USD 130 000 - 180 000
Remote work