Senior Data Engineer — Databricks & AWS Architect

Quantum Technologies. LLC; Tampa (FL); In loco; USD 89.000 - 126.000; Tempo pieno

Descrizione del lavoro

Quantum Technologies. LLC in Tampa, FL is seeking a Data Engineer for a 12-month + extension engagement.

The role requires extensive data engineering and architecture experience, including Databricks lakehouse, Spark, Delta Lake, SQL, and AWS networking and IAM. You will design secure, scalable data pipelines, choose batch vs streaming (Kafka, Structured Streaming), ensure data lineage and Unity Catalog access models, and support migration from Hadoop/Hive.

Competenze

• 12+ years in data engineering or architecture.
• 5+ years on Databricks lakehouse platform.
• Strong experience with Spark, Delta Lake, and SQL.

Mansioni

• Design secure, scalable data pipelines on AWS and on-prem hybrid environments.
• Choose batch vs streaming approaches (Kafka, Structured Streaming).
• Ensure data lineage and Unity Catalog access models.

Conoscenze

Databricks lakehouse

Apache Spark

Delta Lake

SQL

Data modeling

Dimensional modeling

AWS architecture

Networking

IAM

Encryption

Unity Catalog

Data lineage

Hadoop migration

Kafka

Structured Streaming

Disaster recovery

High availability

FinOps

Cost modeling

Descrizione del lavoro

Quantum Technologies. LLC in Tampa, FL is seeking a Data Engineer for a 12-month + extension engagement.

The role requires extensive data engineering and architecture experience, including Databricks lakehouse, Spark, Delta Lake, SQL, and AWS networking and IAM. You will design secure, scalable data pipelines, choose batch vs streaming (Kafka, Structured Streaming), ensure data lineage and Unity Catalog access models, and support migration from Hadoop/Hive.