Databricks Lakehouse Lead Engineer — Multi-Cloud

U.S. Bank; Charlotte (NC); Hybride; USD 133 000 - 157 000; Plein temps

Avantages offerts par ce poste

Healthcare (medical, dental, vision)

401(k) plan

Paid vacation

Résumé du poste

U.S. Bank is seeking a hands-on data engineering leader to design and deliver scalable, governed data products on a Databricks Lakehouse across Azure and AWS.

This role will guide cross-functional teams spanning engineering, product, architecture, and governance to deliver trusted data for analytics, reporting, and AI use cases. You will lead data pipelines and multi-cloud integration, enforce governance and CI/CD practices, and mentor distributed teams while delivering high-quality data assets

Qualifications

• Bachelor’s degree or equivalent work experience.
• Six to eight years of relevant experience.
• Strong hands-on experience with Python, PySpark, SQL, Spark SQL, and ETL/ELT development.

Responsabilités

• Lead and guide Databricks data engineering across Bronze, Silver, and Gold layers, with focus on trusted, reusable Silver and Gold data products.
• Translate business requirements into scalable data architecture, engineering designs, delivery standards, and technical acceptance criteria.
• Remain hands-on in engineering and development, including coding, code review, and code management, while guiding delivery of batch, CDC, streaming, API, and file-based data pipelines.
• Review data models, solution designs, and critical code for quality, security, scalability, performance, and alignment with engineering standards.
• Drive cross-cloud data integration and sharing across Azure, AWS, Databricks, and Snowflake.
• Embed data quality, lineage, governance, PII and PCI controls, monitoring, and reliability into data solutions.
• Establish engineering best practices for CI/CD, testing, source control, deployment, and observability.
• Provide technical leadership through influence across distributed onshore, offshore, and GCC engineering teams, establishing clear standards and guiding delivery without direct people-management responsibility.
• Partner with product, architecture, governance, platform, and business stakeholders to resolve technical dependencies, risks, and delivery challenges.

Connaissances

Python

PySpark

SQL

Spark SQL

ETL/ELT

Databricks

Delta Lake

Unity Catalog

Medallion Arch

Databricks Workflows

Kafka

Azure Event Hubs

Azure

S3

IAM

Snowflake

Data modeling

Power BI

CI/CD

Git

Code review

Formation

Bachelor’s degree

Outils

Databricks

Delta Lake

Unity Catalog

Terraform

Apache Airflow

Datadog

Collibra

Tableau

Databricks Metric Views

Description du poste

U.S. Bank is seeking a hands-on data engineering leader to design and deliver scalable, governed data products on a Databricks Lakehouse across Azure and AWS.

This role will guide cross-functional teams spanning engineering, product, architecture, and governance to deliver trusted data for analytics, reporting, and AI use cases. You will lead data pipelines and multi-cloud integration, enforce governance and CI/CD practices, and mentor distributed teams while delivering high-quality data assets