Senior Data Engineer - Remote, Snowflake & Lakehouse Expert

Highbrow LLC; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

Highbrow LLC seeks a Senior Data Engineer for a remote role supporting Kastle System. You will build and operate batch and streaming pipelines across SQL Server, cloud apps, device/event streams, and CRM systems, with strong Snowflake experience.

You will develop ingestion, transformation, and enrichment pipelines using Flink, Kafka, CDC, SQL, and Python/Java/Scala, and implement lakehouse layers with Iceberg and Trino.

Qualifications

• 6+ years of hands-on experience in data engineering or data platform development.
• Strong SQL and data warehousing capabilities.
• Experience with Snowflake and lakehouse architectures.

Responsibilities

• Build and operate production-grade batch and streaming data pipelines across SQL Server, cloud applications, device/event streams, CRM systems, and third-party sources.
• Develop ingestion, transformation, and enrichment pipelines using Flink, Kafka, CDC, SQL, and Python/Java/Scala.
• Implement lakehouse data layers using Iceberg and Trino.
• Build dimensional and analytical models for buildings, tenants, credentials, devices, and people.
• Implement CDC, late-arriving data, retries, backfills, schema evolution, and data reconciliation.
• Integrate lakehouse with Snowflake, including Iceberg-backed tables, secure sharing, and data contracts.
• Develop automated data-quality checks, pipeline monitoring, lineage, and dashboards.
• Troubleshoot production data issues and optimize queries, storage, and compute.
• Implement security controls and CI/CD pipelines, IaC, and environment promotions.
• Participate in production support, incident resolution, and on-call duties.
• Collaborate with Product, QA, DevOps, Analytics, and distributed teams.

Skills

SQL

Python/Java/Scala

Data modeling

Performance tuning

Data quality

CI/CD

Cloud data platforms

Education

Bachelor’s or Master’s Degree in CS/EE/Math

Tools

Apache Iceberg

Delta Lake

Apache Hudi

Trino

Spark SQL

Snowflake

Kafka

Flink

Debezium

Kubernetes

dbt

Job description

Highbrow LLC seeks a Senior Data Engineer for a remote role supporting Kastle System. You will build and operate batch and streaming pipelines across SQL Server, cloud apps, device/event streams, and CRM systems, with strong Snowflake experience.

You will develop ingestion, transformation, and enrichment pipelines using Flink, Kafka, CDC, SQL, and Python/Java/Scala, and implement lakehouse layers with Iceberg and Trino.