Remote Data Engineer: Databricks Lakehouse & MDM

Lakefusion; United States; Remote; USD 19,000 - 32,000; Full time

Job summary

Lakefusion is seeking a Data Engineer to design and optimize scalable data pipelines on a Databricks Lakehouse Platform. You will enable entity resolution, data quality, and real-time analytics across customer, product, supplier, and asset domains.

You will collaborate with AI/ML engineers, product managers, and data scientists to deliver analytics-ready data products while upholding data governance and reliability across cloud environments.

Qualifications

• Hands-on experience designing and operating scalable data pipelines on Lakehouse platforms.
• Strong proficiency with Spark, Delta Lake, and data modeling for batch and streaming workloads.
• Experience deploying data workloads on AWS or Azure.

Responsibilities

• Design, build, and optimize robust batch and streaming data pipelines on the Databricks Lakehouse Platform, using Delta Live Tables and Change Data Capture patterns.
• Translate business and product data requirements into efficient data models that support intelligent features, analytics, and downstream AI/ML use cases.
• Ensure data reliability, consistency, and performance through rigorous pipeline design, testing, and Spark workload tuning.
• Collaborate closely with AI/ML Engineers, Product Managers, and Data Scientists to deliver pipelines that enable analytics-ready and AI-ready data products.
• Contribute to engineering best practices across monitoring, observability, version control, and automated testing for data workflows.
• Work with MDM data structures and support integrations with modern cloud data services to deliver governed golden records.

Skills

Databricks

Apache Spark

Delta Lake

CI/CD

Terraform

Cloud platforms

Job description

Lakefusion is seeking a Data Engineer to design and optimize scalable data pipelines on a Databricks Lakehouse Platform. You will enable entity resolution, data quality, and real-time analytics across customer, product, supplier, and asset domains.

You will collaborate with AI/ML engineers, product managers, and data scientists to deliver analytics-ready data products while upholding data governance and reliability across cloud environments.