Databricks Data Engineer: Lakehouse & Real-Time Pipelines

OpenTalent; Phoenix (AZ); On-site; USD 104,000 - 114,000; Full time

Benefits offered by this job

Dental insurance

Flexible schedule

Vision insurance

Job summary

OpenTalent in Phoenix, AZ is seeking a Databricks Data Engineer for a long-term contract. You will architect enterprise-grade Lakehouse solutions using Databricks and design end-to-end data pipelines, including real-time streaming, with PySpark, Scala, and SQL.

You will implement data modeling strategies (3NF, dimensional) and develop metadata-driven ingestion, data quality, and governance using Unity Catalog. In-person role with on-site collaboration and CI/CD emphasis.

Qualifications

• Proficient in PySpark/Scala and SQL for data engineering
• Experience architecting Lakehouse solutions on Databricks
• Knowledge of Unity Catalog and data governance is a plus

Responsibilities

• Architect and implement enterprise-grade Lakehouse solutions using Databricks.
• Design and deliver end-to-end data pipelines (batch and real-time).
• Lead cloud-based data lakehouse platform development with diverse data sources.

Skills

PySpark

Scala

SQL

Databricks

Tools

Databricks

Delta Live Tables

Autoloader

Structured Streaming

Databricks Workflows

Apache Airflow

Job description

OpenTalent in Phoenix, AZ is seeking a Databricks Data Engineer for a long-term contract. You will architect enterprise-grade Lakehouse solutions using Databricks and design end-to-end data pipelines, including real-time streaming, with PySpark, Scala, and SQL.

You will implement data modeling strategies (3NF, dimensional) and develop metadata-driven ingestion, data quality, and governance using Unity Catalog. In-person role with on-site collaboration and CI/CD emphasis.