Remote Data Engineer: Lakehouse & CDC for Logistics

Akima Infrastructure Services; North Charleston (SC); On-site; USD 140,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, vision

Life insurance

401(k) and PTO

Job summary

Five Rivers Analytics is seeking a versatile and driven Data Engineer with strong hands-on expertise in Databricks. This remote role is based in South Carolina and focuses on building, optimizing, and maintaining robust data pipelines, with emphasis on reliably capturing source changes and preserving historical truth.

You will design scalable lakehouse architectures using Delta Lake, implement CDC and SCD patterns, and deliver secure, auditable data products to empower downstream consumers as

Qualifications

• Active Secret security clearance.
• Bachelor's degree or equivalent experience in CS/IT/Engineering.
• 8+ years' experience (Bachelor's) or 6+ years (Master's).
• Strong SQL and relational database fundamentals.
• Experience in Agile/SAFe environments.
• Experience modeling data for use in Foundry (Ontologies).

Responsibilities

• Design, build, and maintain scalable batch and streaming ETL/ELT pipelines using Python, SQL, and Databricks Workflows.
• Establish CDC pipelines to ingest incremental source changes into the lakehouse.
• Implement Medallion Architecture (Bronze/Silver/Gold) for data layouts.
• Administer Unity Catalog for data governance and secure access.
• Optimize queries, caching, indexing, and cluster configurations.
• Design robust SCD patterns and historical truth tables in Delta Lake.
• Collaborate with dashboard developers, data analysts, and data scientists.
• Learn source systems to understand data generation and extraction.
• Create clean data models in Databricks SQL as the single source of truth.
• Implement CI/CD and Git integration for deployments and code reviews.
• Implement automated data validation, logging, and alerts.

Skills

Databricks

SQL

Python

CDC

SCD

Delta Lake

Lakehouse

Git

CI/CD

Data Modeling

Education

Bachelor's degree in CS/IT/Engineering

Tools

Databricks Repos

Unity Catalog

Job description

Five Rivers Analytics is seeking a versatile and driven Data Engineer with strong hands-on expertise in Databricks. This remote role is based in South Carolina and focuses on building, optimizing, and maintaining robust data pipelines, with emphasis on reliably capturing source changes and preserving historical truth.

You will design scalable lakehouse architectures using Delta Lake, implement CDC and SCD patterns, and deliver secure, auditable data products to empower downstream consumers as