Technical Lead, Databricks Data Engineering

U.S. Bank; Hopkins (MN); On-site; USD 133,000 - 157,000; Full time

Benefits offered by this job

Healthcare

401(k) plan

Paid vacation

Parental leave

Disability insurance

Employee stock purchase

Job summary

U.S. Bank is seeking an experienced data engineering leader to design and deliver scalable, governed data products on a Databricks Lakehouse across Azure and AWS. You will guide engineering, product, architecture, and governance teams while remaining hands-on with code and pipelines.

You will drive data quality, security, and cross-cloud data sharing, embedding governance into solutions, and defining technical standards for CI/CD, testing, and observability.

Qualifications

• Bachelor’s degree or equivalent work experience.
• 6–8 years of relevant experience.

Responsibilities

• Lead Databricks data engineering across Bronze, Silver, and Gold layers, focusing on trusted Silver/Gold data products.
• Translate business requirements into scalable data architecture, engineering designs, delivery standards, and technical acceptance criteria.
• Remain hands-on in engineering and development, including coding, code review, and code management, while guiding pipelines.
• Review data models, solution designs, and critical code for quality, security, scalability, performance, and alignment with standards.
• Drive cross-cloud data integration across Azure, AWS, Databricks, and Snowflake.
• Embed data quality, lineage, governance, PII and PCI controls, monitoring, and reliability into data solutions.
• Establish engineering best practices for CI/CD, testing, source control, deployment, and observability.
• Provide technical leadership through influence across distributed onshore, offshore, and GCC engineering teams, without direct people-management responsibility.
• Partner with product, architecture, governance, platform, and business stakeholders to resolve dependencies and delivery challenges.

Skills

Python

PySpark

SQL

Spark SQL

ETL/ELT development

Education

Bachelor’s degree

Tools

Databricks

Delta Lake

Unity Catalog

medallion architecture

Databricks Workflows

Kafka

Azure Event Hubs

S3

Job description

U.S. Bank is seeking an experienced data engineering leader to design and deliver scalable, governed data products on a Databricks Lakehouse across Azure and AWS. You will guide engineering, product, architecture, and governance teams while remaining hands-on with code and pipelines.

You will drive data quality, security, and cross-cloud data sharing, embedding governance into solutions, and defining technical standards for CI/CD, testing, and observability.