Remote Databricks Architect — Lakehouse & AI Platform Lead

CEI

Pittsburgh (Allegheny County)

Hybrid

USD 150.000 - 190.000

Vollzeit

vor 22 Stunden
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Benefits dieser Stelle

Medical
Dental
Vision
401(k) match

Zusammenfassung

CEI is seeking a Databricks Technical Architect to design and implement enterprise-grade data platforms that enable analytics, reporting, and AI/ML initiatives. You will lead a team of data engineers, driving end-to-end data solutions with a strong focus on governance, cost efficiency, and platform scalability.

Based in Pittsburgh with hybrid on-site and remote options, you will collaborate with data governance, analytics, and business teams to establish platform standards, mentor engineers, and

Qualifikationen

  • 8–12+ years of experience in data engineering or architecture.
  • 3+ years of hands-on production experience with Databricks.
  • Strong expertise in Spark and PySpark.
  • Experience designing Lakehouse architectures with Delta Lake patterns.
  • Experience with Unity Catalog governance and data lineage.
  • Cloud platform experience: AWS, Azure, or GCP.
  • Infrastructure-as-code using Terraform and/or Databricks Asset Bundles.
  • CI/CD pipelines for data engineering workflows (Git-based).
  • Data modeling approaches incl. dimensional modeling and Data Vault.
  • Cost optimization and performance tuning in Databricks at scale.
  • Knowledge of governance, security, and compliance principles.

Aufgaben

  • Architect end-to-end data solutions in Databricks across ingestion, transformation, governance and serving layers.
  • Lead hands-on development of production data pipelines using PySpark; Scala where appropriate.
  • Establish engineering standards through reusable frameworks and reference implementations.
  • Own Unity Catalog structures: catalogs, schemas, access controls, lineage, and audit.
  • Collaborate with data governance to translate policies into platform controls.
  • Define data serving strategy with Databricks SQL and BI tools (Power BI/Tableau).
  • Implement platform-as-code practices using Terraform and Databricks Asset Bundles.
  • Design CI/CD pipelines for notebooks, jobs, and infrastructure with Git workflows.
  • Define orchestration using Databricks Workflows and Lakeflow; integrate Airflow if needed.
  • Own cost/perf governance: cluster policies, Photon usage, and DBU budgeting.

Kenntnisse

Databricks
PySpark
Lakehouse
Unity Catalog
Cloud platforms
Terraform
CI/CD
Data modeling
Governance
Security

Jobbeschreibung

CEI is seeking a Databricks Technical Architect to design and implement enterprise-grade data platforms that enable analytics, reporting, and AI/ML initiatives. You will lead a team of data engineers, driving end-to-end data solutions with a strong focus on governance, cost efficiency, and platform scalability.

Based in Pittsburgh with hybrid on-site and remote options, you will collaborate with data governance, analytics, and business teams to establish platform standards, mentor engineers, and

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Databricks Lakehouse Architect — Lead Platform & AI Delivery (Remote)
Databricks Lakehouse Architect — Lead Platform & AI Delivery (Remote)

100 Primoris Services Corporation • Texas

Remote
USD 165.000 - 200.000
401k w/employer match
Health/Dental/Vision insurance plans
Paid time off
+2
Remote Databricks Lakehouse Architect – Data Platform Lead
Remote Databricks Lakehouse Architect – Data Platform Lead

Cogniify, Inc. • USA

Remote
USD 170.000 - 175.000
Unlimited PTO
Generous parental leave
Medical, dental, and vision coverage
+6
Remote Databricks Data Engineer - AI Lakehouse Architect
Remote Databricks Data Engineer - AI Lakehouse Architect

Livefront • USA

Remote
USD 150.000 - 190.000
Databricks Lakehouse Architect & Platform Lead
Databricks Lakehouse Architect & Platform Lead

Ethereum Technologies • Boston (MA)

Vor Ort
USD 180.000 - 240.000
Remote Databricks Lakehouse Architect Lead
Remote Databricks Lakehouse Architect Lead

NewVision Software • USA

Remote
USD 120.000 - 180.000
Remote Databricks Architect for Lakehouse & Data Platforms
Remote Databricks Architect for Lakehouse & Data Platforms

Bright Vision Technologies • Fremont (CA)

Remote
USD 115.000 - 165.000
Senior Data Platform Architect for Lakehouse & AI
Senior Data Platform Architect for Lakehouse & AI

Qualified Health PBC • Oregon

Hybrid
USD 215.000 - 235.000
Equity
Health insurance
Hybrid work options
Remote Databricks Data Engineer — AI & Lakehouse Architect
Remote Databricks Data Engineer — AI & Lakehouse Architect

Livefront, Inc. • Peru (IL)

Remote
USD 90.000 - 140.000
Databricks Lakehouse Architect AI Platform Lead
Databricks Lakehouse Architect AI Platform Lead

HCL Technologies Limited • Charlotte (NC)

Vor Ort
USD 128.000 - 250.000
Remote Databricks Data Architect | Lakehouse Expert
Remote Databricks Data Architect | Lakehouse Expert

BairesDev • USA

Remote
CLP 119.880.000 - 179.820.000
100% remote
USD compensation
Remote hardware setup
+4