Senior Data Engineer - Databricks Lakehouse & AWS

Ethereum Technologies; Tampa (FL); In loco; USD 91.000 - 124.000; Tempo pieno

Descrizione del lavoro

Ethereum Technologies in Tampa, FL is seeking a senior Data Engineer to design, build and optimize data pipelines on Databricks lakehouse. This role requires deep expertise in Spark, Delta Lake, SQL and AWS with a focus on secure, scalable data platforms.

The candidate will model data, support migration from legacy Hadoop ecosystems, implement streaming and batch pipelines (Kafka, Structured Streaming) and manage cost and performance on the Databricks platform.

Competenze

• 12+ years in data engineering or architecture.
• 5+ years on the Databricks lakehouse platform.
• Strong Spark, Delta Lake and SQL skills; data modeling experience.
• AWS networking, IAM, encryption, multi-account design.
• Migration planning from Hadoop/Hive/warehouse systems.
• Streaming and batch design with Kafka and Structured Streaming.
• Disaster recovery and high-availability design.
• FinOps and Databricks cost modeling with a business case.

Conoscenze

Databricks lakehouse

Spark

Delta Lake

SQL

Data modeling

AWS architecture

Security design

Migration planning

Streaming design

Disaster recovery

Cost modeling

Architecture docs

Strumenti

Databricks

Kafka

Structured Streaming

IAM

Encryption

Descrizione del lavoro

Ethereum Technologies in Tampa, FL is seeking a senior Data Engineer to design, build and optimize data pipelines on Databricks lakehouse. This role requires deep expertise in Spark, Delta Lake, SQL and AWS with a focus on secure, scalable data platforms.

The candidate will model data, support migration from legacy Hadoop ecosystems, implement streaming and batch pipelines (Kafka, Structured Streaming) and manage cost and performance on the Databricks platform.