Lead Data Engineer, Databricks & Multi-Cloud

U.S. Bank; Chicago (IL); On-site; USD 133,000 - 157,000; Full time

Benefits offered by this job

Healthcare

Life insurance

Disability

Parental leave

401(k)

Paid vacation

Holidays

Adoption assistance

Sick leave

Job summary

U.S. Bank in Chicago seeks a Senior Data Engineer to lead the design and delivery of scalable, governed data products on a Databricks Lakehouse across Azure and AWS.

This hands-on role provides technical leadership across engineering, product, architecture, and governance teams to deliver trusted data for analytics, reporting, and AI use cases. You will guide Databricks data engineering across Bronze, Silver, and Gold layers, stay hands-on with coding and reviews, and drive cross-cloud data

Qualifications

• Bachelor’s degree, or equivalent work experience
• Six to eight years of relevant experience

Responsibilities

• Lead and guide Databricks data engineering across Bronze, Silver, and Gold layers, with particular focus on trusted, reusable Silver and Gold data products.
• Translate business requirements into scalable data architecture, engineering designs, delivery standards, and technical acceptance criteria.
• Remain hands-on in engineering and development, including coding, code review, and code management, while guiding delivery of batch, CDC, streaming, API, and file-based data pipelines.
• Review data models, solution designs, and critical code for quality, security, scalability, performance, and alignment with engineering standards.
• Drive cross-cloud data integration and sharing across Azure, AWS, Databricks, and Snowflake.
• Embed data quality, lineage, governance, PII and PCI controls, monitoring, and reliability into data solutions.
• Establish engineering best practices for CI/CD, testing, source control, deployment, and observability.
• Provide technical leadership through influence across distributed onshore, offshore, and GCC engineering teams, establishing clear standards and guiding delivery without direct people-management responsibility.
• Partner with product, architecture, governance, platform, and business stakeholders to resolve technical dependencies, risks, and delivery challenges.

Skills

Python

PySpark

SQL

ETL/ELT

Azure

AWS

Spark SQL

Git

CI/CD

Data Modeling

Education

Bachelor’s degree, or equivalent work experience

Tools

Databricks

Delta Lake

Unity Catalog

Medallion architecture

Databricks Workflows/Lakeflow

Kafka / Event Hubs

Job description

U.S. Bank in Chicago seeks a Senior Data Engineer to lead the design and delivery of scalable, governed data products on a Databricks Lakehouse across Azure and AWS.

This hands-on role provides technical leadership across engineering, product, architecture, and governance teams to deliver trusted data for analytics, reporting, and AI use cases. You will guide Databricks data engineering across Bronze, Silver, and Gold layers, stay hands-on with coding and reviews, and drive cross-cloud data