Data Architect

Brio Digital

City Of London

Remote

GBP 112,000 - 147,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Brio Digital is seeking a hands-on Data Architect to design a scalable data architecture on AWS with Databricks at the core. You will shape the technical design, set governance standards, and mentor ETL engineers new to Databricks.

You will drive high-performance pipelines, consolidate data sources, and enforce silver/gold data models within a Medallion framework while optimizing costs and storage configurations.

Qualifications

  • Strong AWS experience required for scalable data solutions.
  • Deep hands-on Databricks experience, including performance and cost optimisation.
  • Proven experience delivering Medallion architecture.
  • Strong ETL background.
  • Experience setting data governance standards.
  • Confident mentoring and upskilling engineering teams.

Responsibilities

  • Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines.
  • Bring together source data from files and databases into a single AWS and Databricks platform.
  • Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture.
  • Make the right Databricks choices, including storage modes and compute cluster configuration.
  • Define governance standards, including roles and responsibilities across Databricks and downstream data users.
  • Work with other architects on best practice for data quality and observability.
  • Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns.

Skills

AWS experience
Databricks expertise
ETL development
Data governance
Mentoring engineering teams
Medallion architecture

Tools

Databricks
PySpark
Spark performance tuning
Delta Lake
Unity Catalog
Data quality tooling

Job description

Data Architect (Databricks)

Location: Remote (UK)

Rate: £700 per day Inside IR35

Duration: 12 months

We're looking for a hands-on Data Architect to design a scalable, secure data architecture on AWS, with Databricks as the central engine for all processing and transformation. Data models and tooling are already set, so this role is all about getting the most out of Databricks. You'll shape the technical design, set governance standards and mentor a team of experienced ETL engineers who are new to Databricks.

Key Responsibilities
  • Translate project requirements into technical designs that deliver high-performance, cost-effective pipelines
  • Bring together source data from files and databases into a single AWS and Databricks platform
  • Ensure data is delivered in line with predefined silver and gold models in a Medallion architecture
  • Make the right Databricks choices, including storage modes and compute cluster configuration
  • Define governance standards, including roles and responsibilities across Databricks and downstream data users
  • Work with other architects on best practice for data quality and observability
  • Mentor data engineers new to Databricks through hands-on guidance, training and reusable patterns
Key Requirements
  • Strong AWS experience
  • Deep hands-on Databricks experience, including performance and cost optimisation
  • Proven experience delivering Medallion architecture
  • Strong ETL background
  • Experience setting data governance standards
  • Confident mentoring and upskilling engineering teams
Desirable
  • Unity Catalog
  • PySpark and Spark performance tuning
  • Delta Lake
  • Data quality and observability tooling
  • Experience leading a team's move onto Databricks
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Architect
Data Architect

Brio Digital • Greater London

Remote
GBP 112,000 - 147,000
Data Architect
Data Architect

Brio Digital • United Kingdom

Remote
GBP 112,000 - 147,000
Data Architect - Databricks & AWS
Data Architect - Databricks & AWS

Corecom Consulting • Leeds

Hybrid
GBP 65,000 - 90,000
Databricks Data Architect - AWS & Medallion Architecture
Databricks Data Architect - AWS & Medallion Architecture

Brio Digital • Greater London

Remote
GBP 112,000 - 147,000
Remote Data Architect – Databricks on AWS
Remote Data Architect – Databricks on AWS

Brio Digital • United Kingdom

Remote
GBP 112,000 - 147,000
Databricks Architect
Databricks Architect

Morson Edge • Greater London

On-site
GBP 166,000 - 175,000
Data Architect
Data Architect

Syncarp • Exeter

On-site
GBP 75,000 - 110,000
Databricks Solution Architect
Databricks Solution Architect

Undisclosed Company • Greater London

Hybrid
GBP 112,000 - 147,000
SC Cleared Databricks Architect | Remote
SC Cleared Databricks Architect | Remote

Construction • Greater London

Remote
GBP 111,000 - 120,000
SC Cleared Databricks Architect | Remote
SC Cleared Databricks Architect | Remote

SR2 - Socially Responsible Recruitment • Greater London

Remote
GBP 111,000 - 120,000