Databricks Champion Architect

NTT America, Inc.; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Flexible work options

Learning & Development

Job summary

NTT DATA UK is seeking a Databricks Champion Architect to define, govern, and evangelise modern lakehouse architectures on Databricks. You will own end-to-end architecture across ingestion, transformation, governance, serving and operations, and enforce Bronze/Silver/Gold patterns with data quality and retention controls.

You will lead platform governance using Unity Catalog, design declarative pipelines with Expectations, and champion production-ready engineering standards, CI/CD, and

Qualifications

• 2+ years of hands-on Databricks experience gained recently with modern feature usage.
• Demonstrable architecture ownership (solution design, governance models, platform standards).

Responsibilities

• Own end-to-end Databricks solution architecture across ingestion, transformation, governance, serving and operations.
• Define and enforce Medallion Architecture standards and reference designs (Bronze/Silver/Gold).
• Architect ingestion using Lakeflow Connect, AutoLoader, batch/streaming/CDC strategies.

Skills

Databricks

Solution architecture

Unity Catalog

DLT (Declarative Pipelines with 0r

Tools

Lakeflow Connect

AutoLoader

CI/CD

Job description

The team you'll be working with:

We are looking for a Databricks Champion Architect to define, govern, and evangelise modern lakehouse architectures on Databricks. This role blends solution architecture, hands-on technical leadership, and platform enablement—setting standards and accelerating delivery teams through patterns, reference implementations, and best practices.

A minimum bar is 2+ years of Databricks experience in recent years, demonstrating strong familiarity with modern capabilities and current platform patterns (not legacy Spark-only experience).

What you'll be doing:

• Own the end-to-end Databricks solution architecture across ingestion, transformation, governance, serving, and operations.

• Define and enforce Medallion Architecture (Bronze/Silver/Gold) standards and reference designs (including data quality, SCD/CDC patterns, performance, and retention).

• Architect ingestion approaches using Lakeflow Connect, AutoLoader, batch/streaming/CDC strategies, and enterprise integration patterns.

• Establish platform governance using Unity Catalog:

• Namespace strategy, access models, lineage, data sharing, and secure-by-design patterns.

• Define the approach for Declarative Pipelines with Expectations (DLT):

• Data quality strategy, validation rules, quarantine patterns, and observability standards.

• Champion “production-ready” engineering standards:

• CI/CD approach, environment strategy (dev/test/prod), monitoring, runbooks, and operational readiness.

• Drive stakeholder alignment:

• Work with security, enterprise architecture, data governance, platform teams, and delivery squads.

• Enable and upskill teams:

• Provide playbooks, templates, architecture decision records (ADRs), design reviews, and technical coaching.

• Contribute to pre-sales and roadmap:

• High-level designs, estimation, risk/dependency management, and technical proposals.

What experience you'll bring:

Minimum Experience

• 2+ years of hands-on Databricks experience gained recently (e.g., within the last 2–3 years) with evidence of modern feature usage and production delivery.

• Demonstrable architecture ownership (solution design, governance models, or platform standards), even if overall industry experience is greater than 2 years.

Must Have

• Databricks Certification (active/current): two of:

• Databricks Certified Data Engineer Associate/Professional

• Databricks Certified Machine Learning Associate/Professional

• Databricks Certified Generative AI Engineer (Associate)

• Medallion Architecture design ownership:

• Proven ability to design Bronze/Silver/Gold layers, data contracts, data lifecycle, and serving patterns (BI, APIs, ML features).

• Unity Catalog architecture experience:

• Governance model design (catalog strategy, grants), lineage, and secure access patterns.

• Declarative Pipelines with Expectations (DLT):

• Architectural understanding plus practical experience implementing expectations, failure handling, and quality reporting.

• Ingestion architecture & delivery:

• Hands-on experience designing ingestion using AutoLoader and/or Lakeflow Connect (including schema evolution, incremental loads, and operational patterns).

• Databricks experience with latest capabilities:

• Candidate can clearly articulate what modern features they used recently and why (platform evolution awareness is essential for this role).

Should Have

• Strong command of Delta Lake and performance patterns:

• MERGE/CDC strategies, partitioning/file sizing, OPTIMIZE/ZORDER, VACUUM, table maintenance automation.

• Production architecture practices:

• Environment separation, secrets management, job orchestration standards (Databricks Workflows), testing strategy, and observability.

• Cloud platform integration understanding (one or more of Azure/AWS/GCP):

• Identity, networking, storage, and security integration considerations.

• Ability to influence and standardise across teams:

• Templates, reference repos, reusable components, and governance guardrails.

Nice to Have

• Lakeflow ingestion connectors experience (specific connector implementations).

• RBAC / masking expertise:

• Row-level security, column masking, sensitive data classification patterns in Unity Catalog.

• GenAI capabilities on Databricks:

• Mosaic AI, Vector Search, model serving, RAG architectures, AI Functions.

• Lakebase awareness or hands-on experience.

• Workload & query optimisation at scale:

• Photon adoption patterns, cluster policy design, skew/shuffle tuning, streaming tuning, concurrency strategies.

• Cost governance:

• Understanding cost drivers (DBUs/compute types), chargeback/showback approaches, cluster policies, and cost controls.

Who we are:

We’re a business with a global reach that empowers local teams, and we undertake hugely exciting work that is genuinely changing the world. Our advanced portfolio of consulting, applications, business process, cloud, and infrastructure services will allow you to achieve great things by working with brilliant colleagues, and clients, on exciting projects.

Our inclusive work environment prioritises mutual respect, accountability, and continuous learning for all our people. This approach fosters collaboration, well-being, growth, and agility, leading to a more diverse, innovative, and competitive organisation. We are also proud to share that we have a range of Inclusion Networks such as: the Women’s Business Network, Cultural and Ethnicity Network, LGBTQ+ & Allies Network, Neurodiversity Network and the Parent Network.

For more information on Diversity, Equity and Inclusion please click here: Creating Inclusion Together at NTT DATA UK | NTT DATA (https://uk.nttdata.com/creating-inclusion-together)

We are an equal opportunities employer. We believe in the fair treatment of all our employees and commit to promoting equity and diversity in our employment practices. We are also a proud Disability Confident Committed Employer - we are committed to creating a diverse and inclusive workforce. We actively collaborate with individuals who have disabilities and long-term health conditions which have an effect on their ability to do normal daily activities, ensuring that barriers are eliminated when it comes to employment opportunities. In line with our commitment, we guarantee an interview to applicants who declare to us, during the application process, that they have a disability and meet the minimum requirements for the role. If you require any reasonable adjustments during the recruitment process, please let us know. Join us in building a truly diverse and empowered team.

what we’ll offer you:

We offer a range of tailored benefits that support your physical, emotional, and financial wellbeing. Our Learning and Development team ensure that there are continuous growth and development opportunities for our people. We also offer the opportunity to have flexible work options.

You can find more information about NTT DATA UK & Ireland here: https://uk.nttdata.com/