Lead Data Engineer - Databricks & Multi-Cloud

U.S. Bank; Gresham (OR); On-site; USD 133,000 - 157,000; Full time

Benefits offered by this job

Healthcare

Retirement plan

Paid vacation

Job summary

U.S. Bank is seeking a senior data engineering leader to design and deliver scalable, governed data products on a Databricks Lakehouse across Azure and AWS.

You will guide engineering, product, architecture, and governance teams and deliver trusted data for analytics, reporting, and AI use cases. You will stay hands-on in engineering and development, including coding, code review, and code management, while guiding batch, CDC, streaming, API, and file-based pipelines.

Qualifications

• Bachelor's degree or equivalent work experience.

Responsibilities

• Lead and guide Databricks data engineering across Bronze, Silver, and Gold layers with focus on trusted, reusable Silver and Gold data products.
• Translate business requirements into scalable data architecture, engineering designs, delivery standards, and technical acceptance criteria.
• Remain hands-on in engineering and development, including coding, code review, and code management, while guiding batch, CDC, streaming, API, and file-based data pipelines.
• Review data models, solution designs, and critical code for quality, security, scalability, performance, and alignment with engineering standards.
• Drive cross-cloud data integration and sharing across Azure, AWS, Databricks, and Snowflake.
• Embed data quality, lineage, governance, PII and PCI controls, monitoring, and reliability into data solutions.
• Establish engineering best practices for CI/CD, testing, source control, deployment, and observability.
• Provide technical leadership through influence across distributed teams, establishing clear standards and guiding delivery without direct people-management responsibility.
• Partner with product, architecture, governance, platform, and business stakeholders to resolve technical dependencies, risks, and delivery challenges.

Skills

Python

PySpark

SQL

Spark SQL

ETL/ELT

Databricks

Delta Lake

Unity Catalog

Medallion architecture

Databricks Workflows/Lakeflow

Kafka

Azure Event Hubs

Azure

AWS

Snowflake

Delta Sharing

Delta UniForm

Apache Iceberg

Power BI

DAX

Git

CI/CD

Education

Bachelor's degree

Tools

Databricks

Delta Lake

Unity Catalog

medallion architecture

Databricks Workflows

Job description

U.S. Bank is seeking a senior data engineering leader to design and deliver scalable, governed data products on a Databricks Lakehouse across Azure and AWS.

You will guide engineering, product, architecture, and governance teams and deliver trusted data for analytics, reporting, and AI use cases. You will stay hands-on in engineering and development, including coding, code review, and code management, while guiding batch, CDC, streaming, API, and file-based pipelines.