Principal Data Platform Architect — Databricks Expert

Colibri Digital

United States

Remote

GBP 100,000 - 150,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Private health insurance
Remote-first work model
Certification access
Global client exposure

Job summary

Colibri Digital seeks a Principal Data Engineer to bridge complex data architectures and strategic business value. You will serve as the primary technical authority for clients, ensuring Databricks data platforms are scalable, resilient, and aligned with long-term business goals.

You will drive solution architecture, mentor teams, and lead multi-year roadmaps across Azure/AWS, PySpark, SparkSQL, and data governance, while engaging stakeholders with clarity and impact.

Qualifications

  • Proven experience in a principal engineering role.
  • Extensive experience with cloud data platforms (Azure or AWS) focusing on Databricks.
  • Strong Python (PySpark) and SparkSQL skills.
  • Strong data modelling concepts relational and non-relational databases.
  • Proficiency in SQL and experience with data integration and ETL tools.
  • Excellent knowledge of big data technologies and frameworks.
  • Strong knowledge of data governance and data security best practices.
  • Remote-first with client-facing responsibilities.
  • Excellent communication and stakeholder management skills.

Responsibilities

  • Act as the primary strategic partner to client business owners, aligning technical data solutions with corporate goals while championing reliability and "clean data" for all consumers.
  • Drive the development of complex, large-scale data architectures and multi-year technology roadmaps, balancing technical innovation with cost efficiency and operational stability.
  • Oversee delivery performance, ensuring the quality and resilience of high-impact data pipelines while managing capacity planning and team velocity.
  • Lead the triage and resolution of critical platform incidents, taking full ownership of root-cause prevention and maintaining transparent communication with clients during recovery.
  • Implement robust governance frameworks and compliance controls, acting as the authoritative lead on risk mitigation and the primary technical contact for regulatory matters.
  • Champion an organisational culture of knowledge sharing, representing the firm at industry events and establishing best practices across communities of practice.
  • Influence long-term organizational health by driving platform efficiency, managing engineering budgets, and leading strategic hiring and retention initiatives.

Skills

Leadership
Solution architecture
Stakeholder management
Python
Data modelling
Data governance
Communication
Remote work

Tools

Databricks
Azure
AWS
PySpark
SparkSQL
SQL
ETL tools

Job description

Colibri Digital seeks a Principal Data Engineer to bridge complex data architectures and strategic business value. You will serve as the primary technical authority for clients, ensuring Databricks data platforms are scalable, resilient, and aligned with long-term business goals.

You will drive solution architecture, mentor teams, and lead multi-year roadmaps across Azure/AWS, PySpark, SparkSQL, and data governance, while engaging stakeholders with clarity and impact.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Data Engineer
Principal Data Engineer

Colibri Digital • United States

Remote
GBP 100,000 - 150,000
Private health insurance
Remote-first work model
Certification access
+1
Principal Data Engineer: Databricks & Azure Lead
Principal Data Engineer: Databricks & Azure Lead

Cushman & Wakefield • Nashville (TN)

Hybrid
USD 157,000 - 185,000
Databricks Lead Architect - Multi-Cloud Data Platforms
Databricks Lead Architect - Multi-Cloud Data Platforms

Arting Digital Private Limited • United States

Remote
USD 160,000 - 220,000
Remote Data Platform Architect (Databricks)
Remote Data Platform Architect (Databricks)

Capgemini • Atlanta (GA)

Remote
USD 73,000 - 174,000
Paid time off
Health insurance
Retirement savings plans (401(k))
+1
Principal Data Engineer: Azure & Databricks Leader
Principal Data Engineer: Azure & Databricks Leader

Cushman & Wakefield • Creve Coeur (MO)

Hybrid
USD 157,000 - 185,000
Health insurance
Vision insurance
Dental insurance
+2
Data Architect: Databricks Platform & AI-Driven Analytics
Data Architect: Databricks Platform & AI-Driven Analytics

G-P • United States

Remote
USD 150,000 - 230,000
Paid parental leave
Flexible time off
Medical, dental, vision insurance
+1
Lead Databricks Architect – Multi-Cloud Data Platform, CI/CD
Lead Databricks Architect – Multi-Cloud Data Platform, CI/CD

Artingdigital • United States

Remote
USD 140,000 - 200,000
Principal Architect - Databricks
Principal Architect - Databricks

Tiger Analytics • Texas

On-site
USD 130,000 - 160,000
Principal Data Engineer: Real-Time Databricks Platform
Principal Data Engineer: Real-Time Databricks Platform

Alaska Airlines • SeaTac (WA)

On-site
USD 139,000 - 208,000
Free stand-by travel privileges
Comprehensive well-being programs
Generous 401k match
+2
Databricks Solutions Architect: Lead Data & ML Platform
Databricks Solutions Architect: Lead Data & ML Platform

Centraprise • San Francisco (CA)

On-site
USD 180,000 - 260,000