Senior Databricks Engineer - Delta Lake & ML Ops

Long Finch Technologies, LLC.; Galena (OH); On-site; USD 140,000 - 170,000; Full time

Job summary

Long Finch Technologies, LLC. is seeking an experienced data engineer to design and implement large-scale data pipelines on Databricks and AWS. The role focuses on building Lakehouse architectures with Delta Lake, and ensuring high-performance ELT/ETL processing.

You will work with PySpark/Scala Spark, streaming DL/T, ML Ops on Databricks, and data mesh principles to deliver scalable, cost-efficient solutions for production workloads.

Qualifications

• Deep knowledge in Databricks & AWS ecosystems.
• Delta Lake and Lakehouse architecture (Delta Lake, Lake flow, Lake Base).
• PySpark/Scala Spark experience.
• High-volume production-grade Databricks ELT/ETL engineering.
• Streaming/DLT experience.
• ML Ops on Databricks.
• Data Mesh architecture knowledge.
• Advance cost/performance engineering.
• Databricks & AWS data engineer.

Skills

Databricks

AWS ecosystem

Delta Lake

Lakehouse architecture

PySpark

Scala Spark

ELT/ETL engineering

Streaming

DLT

ML Ops

Data Mesh

Cost/perf engineering

Databricks AWS data eng

Job description

Long Finch Technologies, LLC. is seeking an experienced data engineer to design and implement large-scale data pipelines on Databricks and AWS. The role focuses on building Lakehouse architectures with Delta Lake, and ensuring high-performance ELT/ETL processing.

You will work with PySpark/Scala Spark, streaming DL/T, ML Ops on Databricks, and data mesh principles to deliver scalable, cost-efficient solutions for production workloads.