Remote Databricks Lakehouse Architect

Visa Hunt; United States; On-site; USD 170,000 - 230,000; Full time

Benefits offered by this job

Visa sponsorship

Job summary

Bounteous seeks a Lead Databricks Engineer/Architect to design, build, and scale a modern cloud-native lakehouse platform. You will own end-to-end data ecosystem architecture across AWS, Azure, or GCP, partnering with data science and analytics teams to productionize ML workloads and set engineering standards.

You will lead governance using Unity Catalog, optimize Spark workloads for performance and cost, and mentor a team of data engineers while aligning with stakeholders on the data platform

Qualifications

• 8+ years of data engineering experience, with 4+ years building production workloads on Databricks.
• Deep expertise in Apache Spark (PySpark) and performance tuning.
• Production experience on AWS/Azure/GCP and data governance.

Responsibilities

• Architect and lead the implementation of an enterprise lakehouse on Databricks across clouds.
• Design scalable pipelines using PySpark, Spark SQL, and Delta Live Tables.
• Define platform standards for data modeling, CI/CD, code quality, testing, observability, and cost optimization.
• Lead governance with Unity Catalog including data lineage and PII handling.
• Mentor data engineers and lead architecture reviews.

Skills

Databricks

Apache Spark

Python

SQL

Cloud (AWS/Azure/GCP)

Terraform

Data modeling

Mentoring

CI/CD

Tools

Delta Lake

Unity Catalog

Databricks Workflows

Delta Live Tables

Git

Terraform

dbx

Job description

Bounteous seeks a Lead Databricks Engineer/Architect to design, build, and scale a modern cloud-native lakehouse platform. You will own end-to-end data ecosystem architecture across AWS, Azure, or GCP, partnering with data science and analytics teams to productionize ML workloads and set engineering standards.

You will lead governance using Unity Catalog, optimize Spark workloads for performance and cost, and mentor a team of data engineers while aligning with stakeholders on the data platform