Solution Architect
Overview of the Role
The Data Solution Architect is responsible for defining and owning the architecture of our cloud data platform and providing technical direction across its full lifecycle, from ingestion to analytics, BI, ML and AI. The role leads the data architecture practice within the Data Tribe and sets the overall technical vision for a modern lakehouse platform built on AWS and Databricks, serving multiple brands and markets in a regulated industry.
What You'll Do
Architecture & Vision
- Define the target architecture of the data platform: its main components, data flows, interfaces and integration with operational and external systems.
- Design the lakehouse and medallion architecture (Bronze/Silver/Gold), including data organisation, isolation and sharing models across brands and markets.
- Define the coexistence model between Databricks (analytics, BI, ML, AI) and AWS (operational services), including storage, integration and governance boundaries.
- Establish a clear architectural vision that serves as a common reference for engineering, product and business stakeholders.
Data Platform Engineering
- Design batch and streaming ingestion patterns (Kafka/MSK, CDC, batch), including real-time and low-latency use cases.
- Lead the architecture of historical data migration from existing systems (cloud data warehouse and on-premises sources) to the new platform, including cutover and reconciliation strategy.
- Define data modelling standards, data quality and lineage practices, and table format strategy (Delta / Iceberg).
- Design data governance and access control (Unity Catalog, Lake Formation, IAM), ensuring market-level isolation and regulatory compliance.
Architecture Governance
- Own architecture principles, standards and reference architectures.
- Maintain Architecture Decision Records (ADRs) for significant technical decisions.
- Lead architecture reviews and ensure solutions follow agreed platform standards.
- Define and drive adoption of data contracts between data producers and consumers, covering schema, semantics, quality expectations, SLAs and ownership.
Leadership & Collaboration
- Supervise and guide data engineering teams; review designs and code and provide constructive feedback.
- Evaluate the existing architecture and work with teams on continuous improvement.
- Research emerging data technologies and propose architectural changes where they add value.
- Collaborate with other architects to establish common standards, patterns and principles.
- Support Programme and Product Managers in defining data strategy, roadmap and capacity allocation for enablement work.
- Work with vendors and partners (e.g. AWS, Databricks) on architecture reviews and technical decisions.
- Mentor engineers and help build in-house capability on the new platform.
What You'll Bring
Working Experience
- 7+ years in IT/software architecture or senior data engineering, with at least 3-4 years designing cloud data platforms.
- Proven hands-on experience with AWS data services (S3, Glue, Lake Formation, MSK, Redshift, Athena, Lambda, IAM/KMS).
- Experience with Databricks (Unity Catalog, Delta Lake, Workflows/DLT, Databricks SQL) is strongly preferred.
- Experience designing and delivering lakehouse/medallion architectures in production.
- Experience leading large-scale data migrations (data warehouse and/or on-premises to cloud).
- Experience with streaming architectures (Kafka, Spark Structured Streaming, Flink) and CDC.
- Experience performing design and code reviews and establishing engineering standards.
- Project management or technical leadership experience is an advantage.
Standard Qualifications
- Expert knowledge of data architecture, data modelling (dimensional, data vault or similar) and distributed data processing.
- Strong programming skills in Python/PySpark and SQL.
- Strong knowledge of data governance, security and access control in cloud environments.
- Knowledge of enterprise and data integration patterns (event-driven, CDC, batch, data sharing).
- Strong understanding of networking and security principles in cloud environments (VPC, private connectivity, encryption).
- Infrastructure as Code (Terraform) and CI/CD for data platforms.
- Business analysis skills: ability to translate business and regulatory requirements into data architecture.
- Strong organisational and leadership skills.
Preferable Qualifications
- Databricks and/or AWS certifications (e.g. Databricks Data Engineer Professional, AWS Solutions Architect / Data Analytics).
- Experience with Apache Iceberg and multi-engine lakehouse setups.
- Hands-on experience implementing data contracts and schema governance (e.g. schema registry, contract testing in CI/CD).
- Experience in multi-tenant, multi-region or multi-jurisdiction data platforms.
- Experience in regulated industries (gambling, fintech, banking) with data residency and audit requirements.
- Experience enabling BI (Tableau, Databricks SQL) and ML/AI workloads (MLflow, feature stores, GenAI).
- Knowledge of DR strategies a