Remote Lead Data Engineer — Lakehouse & Data Governance

Ufs Llc; United States; Remote; USD 140.000 - 190.000; Vollzeit

Zusammenfassung

Navanta is seeking a Lead Data Engineer to own the data backbone for public Call Report data and secure ingestion from bank cores into lakehouses as clients stand up on-prem environments. You will design the lakehouse using Iceberg-like tech, implement secure, observable pipelines, and collaborate with AI/ML, security, and platform teams to maintain a clean, modelable data foundation.

The role emphasizes end-to-end data ownership, strong Python/SQL skills, and experience with lakehouse platforms

Qualifikationen

• 8–12+ years in data engineering with end-to-end ownership of ingestion through serving and 2+ years in a lead or senior role.
• Strong Python and expert SQL; rigorous data modeling for analytics.
• Hands-on lakehouse experience (Iceberg/Delta/Hudi or equivalent) and modern transformation tooling.
• Built reliable pipelines from messy operational and transactional source systems.
• Comfort with CDC mechanics and the realities of pulling from databases you do not control.

Aufgaben

• Design the lakehouse: Iceberg or similar on object storage, catalog for table management and per-bank isolation, dbt models, and a query engine.
• Build secure, least-privilege ingestion from bank systems with CDC and batch/SFTP fallbacks.
• Own data modeling for semantic and metric layers; manage deposits, concentration, and asset quality metrics.
• Handle schema drift, data quality, and reconciliation; make ingestion observable and recoverable.
• Partner with AI/ML and Security on PII classification and governance aligned with regulatory data handling.
• Document data lineage, transformation logic, and access controls for audits.

Kenntnisse

Python

SQL

Lakehouse

Data Modeling

Data Governance

CDC

Security

Observability

Cloud

Ausbildung

Bachelor's degree in CS/Math/IS

Tools

Iceberg

Delta

Hudi

dbt

Kafka/Redpanda

PostgreSQL

SQL Server

SQL

Jobbeschreibung

Navanta is seeking a Lead Data Engineer to own the data backbone for public Call Report data and secure ingestion from bank cores into lakehouses as clients stand up on-prem environments. You will design the lakehouse using Iceberg-like tech, implement secure, observable pipelines, and collaborate with AI/ML, security, and platform teams to maintain a clean, modelable data foundation.

The role emphasizes end-to-end data ownership, strong Python/SQL skills, and experience with lakehouse platforms