Senior Data Engineer - Databricks & AWS Lakehouse

Artifintech; Tampa (FL); In loco; USD 91.000 - 124.000; Tempo pieno

Descrizione del lavoro

Artifintech in Tampa, FL seeks a senior Data Engineer with 12+ years in data engineering or architecture, including 5+ years on the Databricks lakehouse. You’ll work with Spark, Delta Lake, and SQL, plus secure data modeling and Unity Catalog concepts.

Responsibilities include designing batch and streaming pipelines (Kafka, Structured Streaming), migrating from Hadoop/Hive, ensuring privacy for PII/NPI, implementing disaster recovery, cost modeling for FinOps, and clear architecture

Competenze

• 12+ years in data engineering or architecture.
• 5+ years on Databricks lakehouse platform.
• Strong Spark, Delta Lake and SQL.
• AWS architecture: networking, IAM, encryption.
• Secure design for PII/NPI with Unity Catalog access models.
• Migration planning from Hadoop/Hive/warehouse systems.
• Batch and streaming design with Kafka/Structured Streaming.
• Disaster recovery and high-availability design.
• Databricks cost modeling and FinOps.

Conoscenze

Data engineering

Databricks lakehouse

Spark

Delta Lake

SQL modeling

Data modeling

AWS architecture

Security design

Migration planning

Streaming design

Disaster recovery

Cost modeling

FinOps

Stakeholder comms

Strumenti

Kafka

Delta Lake

Unity Catalog

Descrizione del lavoro

Artifintech in Tampa, FL seeks a senior Data Engineer with 12+ years in data engineering or architecture, including 5+ years on the Databricks lakehouse. You’ll work with Spark, Delta Lake, and SQL, plus secure data modeling and Unity Catalog concepts.

Responsibilities include designing batch and streaming pipelines (Kafka, Structured Streaming), migrating from Hadoop/Hive, ensuring privacy for PII/NPI, implementing disaster recovery, cost modeling for FinOps, and clear architecture