Databricks Data Architect on AWS — Medallion Governance

Brio Digital

City Of London

Remote

GBP 112,000 - 147,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Brio Digital is seeking a hands-on Data Architect to design a scalable data architecture on AWS with Databricks at the core. You will shape the technical design, set governance standards, and mentor ETL engineers new to Databricks.

You will drive high-performance pipelines, consolidate data sources, and enforce silver/gold data models within a Medallion framework while optimizing costs and storage configurations.

Qualifications

  • Strong AWS experience required for scalable data solutions.
  • Deep hands-on Databricks experience, including performance and cost optimisation.
  • Proven experience delivering Medallion architecture.
  • Strong ETL background.
  • Experience setting data governance standards.
  • Confident mentoring and upskilling engineering teams.

Responsibilities

  • Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines.
  • Bring together source data from files and databases into a single AWS and Databricks platform.
  • Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture.
  • Make the right Databricks choices, including storage modes and compute cluster configuration.
  • Define governance standards, including roles and responsibilities across Databricks and downstream data users.
  • Work with other architects on best practice for data quality and observability.
  • Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns.

Skills

AWS experience
Databricks expertise
ETL development
Data governance
Mentoring engineering teams
Medallion architecture

Tools

Databricks
PySpark
Spark performance tuning
Delta Lake
Unity Catalog
Data quality tooling

Job description

Brio Digital is seeking a hands-on Data Architect to design a scalable data architecture on AWS with Databricks at the core. You will shape the technical design, set governance standards, and mentor ETL engineers new to Databricks.

You will drive high-performance pipelines, consolidate data sources, and enforce silver/gold data models within a Medallion framework while optimizing costs and storage configurations.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Data Architect - AWS & Medallion Architecture
Databricks Data Architect - AWS & Medallion Architecture

Brio Digital • Greater London

Remote
GBP 112,000 - 147,000
Remote Data Architect – Databricks on AWS
Remote Data Architect – Databricks on AWS

Brio Digital • United Kingdom

Remote
GBP 112,000 - 147,000
Data Architect: AWS & Databricks | Medallion Lakehouse
Data Architect: AWS & Databricks | Medallion Lakehouse

Corecom Consulting • Leeds

Hybrid
GBP 65,000 - 90,000
Data Architect
Data Architect

Brio Digital • United Kingdom

Remote
GBP 112,000 - 147,000
Data Architect
Data Architect

Brio Digital • City Of London

Remote
GBP 112,000 - 147,000
Data Architect
Data Architect

Brio Digital • Greater London

Remote
GBP 112,000 - 147,000
Data Architect - Databricks & AWS
Data Architect - Databricks & AWS

Corecom Consulting • Leeds

Hybrid
GBP 65,000 - 90,000
Databricks Architect
Databricks Architect

Morson Edge • Greater London

On-site
GBP 166,000 - 175,000
Senior Cloud Data Platform Architect - Databricks & AWS
Senior Cloud Data Platform Architect - Databricks & AWS

Morson Edge • Greater London

On-site
GBP 166,000 - 175,000
SC Cleared Databricks Architect - Remote Data Platform Lead
SC Cleared Databricks Architect - Remote Data Platform Lead

SR2 - Socially Responsible Recruitment • Greater London

Remote
GBP 111,000 - 120,000