Remote Databricks Lakehouse Architect & Governance

Pythian; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Training allowance

Certification

Home office budget

Wellness budget

Paid vacation

Volunteer day

Job summary

Pythian is seeking a senior data engineer/architect to own end-to-end data platform architecture for ingestion, lakehouse design, and analytics delivery. You will build pipelines, transform data with Spark and SQL, and shape the semantic layer for BI reporting.

The role requires eight+ years in data engineering, deep hands-on experience with Databricks or Microsoft Fabric, and strong data governance and modeling skills. Remote US-based with extensive training and certification opportunities.

Qualifications

• Eight or more years in data engineering.
• Proven hands on delivery and architecture ownership.
• Experience with Databricks or Fabric and knowledge of the other.
• Strong Spark and SQL with production Python.
• Experience with Delta Lake and lakehouse patterns.
• Power BI and semantic modeling.
• Data governance: classification, lineage, cataloging, access control.
• CI/CD and testing for data workflows.

Responsibilities

• Own end-to-end architecture: ingestion, lakehouse/warehouse, modeling, and delivery.
• Build pipelines, Spark/SQL transformations, and data models; review team code.
• Design lakehouse on Databricks or Fabric; manage medallion layering.
• Select Databricks or Fabric based on workloads, licensing, and cost.
• Set up governance via Unity Catalog, Purview, or equivalents.
• Design and build ingestion from databases, SaaS, APIs, files, legacy systems.

Skills

Architecture ownership

Databricks

Microsoft Fabric

Spark

SQL

Python

Data modeling

Data governance

CI/CD for data

Tools

Databricks

Microsoft Fabric

Purview

Delta Lake

Unity Catalog

Job description

Pythian is seeking a senior data engineer/architect to own end-to-end data platform architecture for ingestion, lakehouse design, and analytics delivery. You will build pipelines, transform data with Spark and SQL, and shape the semantic layer for BI reporting.

The role requires eight+ years in data engineering, deep hands-on experience with Databricks or Microsoft Fabric, and strong data governance and modeling skills. Remote US-based with extensive training and certification opportunities.