Databricks Data Platform Lead

U.S. Bank; Minneapolis (MN); Sur place; USD 133 000 - 157 000; Plein temps

Avantages offerts par ce poste

Healthcare coverage

Retirement plan

Paid vacation

Résumé du poste

U.S. Bank is seeking a hands-on Data Engineering Lead to drive scalable data products on a Databricks Lakehouse, spanning Azure and AWS. You will guide architecture, governance, and delivery while coding and reviewing critical pipelines for batch, streaming, and API data flows.

The role requires 6–8 years of experience, strong Python/PySpark/SQL skills, and cloud data expertise across Azure and AWS. Hybrid work near Minneapolis with strong collaboration across global teams.

Qualifications

• Bachelor's degree or equivalent work experience.
• 6–8 years of relevant experience.

Responsabilités

• Lead and guide Databricks data engineering across Bronze, Silver, and Gold layers with focus on trusted Silver/Gold data products.
• Translate business requirements into scalable data architecture and delivery standards.
• Remain hands-on in engineering and development including coding, code review, and code management.
• Review data models and solution designs for quality, security, and scalability.
• Drive cross-cloud data integration across Azure, AWS, Databricks, and Snowflake.
• Embed data quality, lineage, governance, and PCI/PII controls into data solutions.
• Establish engineering best practices for CI/CD, testing, and observability.
• Provide technical leadership across distributed teams via influence.
• Partner with stakeholders to resolve dependencies and risks.

Connaissances

Python

PySpark

SQL

Spark SQL

ETL/ELT

Databricks

Delta Lake

Unity Catalog

medallion architecture

Databricks Workflows

Lakeflow

Azure

AWS

Kafka

Formation

Bachelor's degree

Outils

Databricks

Delta Lake

Unity Catalog

Databricks Workflows

Lakehouse

Snowflake

Description du poste

U.S. Bank is seeking a hands-on Data Engineering Lead to drive scalable data products on a Databricks Lakehouse, spanning Azure and AWS. You will guide architecture, governance, and delivery while coding and reviewing critical pipelines for batch, streaming, and API data flows.

The role requires 6–8 years of experience, strong Python/PySpark/SQL skills, and cloud data expertise across Azure and AWS. Hybrid work near Minneapolis with strong collaboration across global teams.