Global Real-Time Data Platform Architect

Formula.; Greater London; On-site; GBP 120,000 - 160,000; Full time

Benefits offered by this job

Enhanced pension

Private healthcare

Life insurance & income protection

Self-development fund £1,000

Enhanced parental leave

Job summary

Global Tech is seeking a Principal Data Solution Architect to design and deliver distributed data platforms at scale for real-time digital experiences. You will architect streaming rails, data stores, and cloud-native solutions while collaborating with engineering teams to ensure scalable, compliant outcomes.

The role requires hands-on expertise with Spark, Databricks, Cassandra, and OLTP databases, with a focus on performance, security, and cost efficiency at high volumes.

Qualifications

• Extensive experience designing and implementing distributed data platforms at scale.
• Proven track record architecting real-time, low-latency streaming platforms and event-driven architectures.
• Strong hands-on experience with Apache Spark and Databricks, including performance tuning at scale.
• Experience with Cassandra or similar distributed databases, including partitioning, consistency models, and optimisation.
• Solid experience with OLTP databases such as PostgreSQL or MySQL.
• Cloud-native delivery experience on AWS, GCP, or Azure.
• Experience delivering platforms in high-volume B2C environments at real scale.
• Track record delivering compliant data solutions in regulated environments such as PCI, SOX, or HIPAA.
• Experience productionising ML/AI capabilities including feature stores, training pipelines, and model serving.

Responsibilities

• Design and deliver distributed data platforms at scale, covering real-time streaming infrastructure, distributed compute, object storage, and SQL/NoSQL data stores.
• Architect real-time streaming solutions using Kafka and Pulsar, ensuring low-latency data delivery to downstream applications.
• Design data structures for distributed systems including Cassandra, optimising for read/write patterns, scalability, and performance.
• Deliver cloud-native solutions on AWS, leveraging Databricks, S3, and distributed compute frameworks.
• Work closely with application and engineering teams to understand data access patterns and translate them into scalable platform solutions.
• Produce ADRs, data models, and technical designs that support delivery of business goals.
• Create pragmatic technology roadmaps balancing near-term delivery with longer-term target state architecture.
• Mentor engineers and architects on distributed data platform patterns.
• Design with security, cost optimisation, performance, and regulatory compliance in mind throughout.

Skills

Distributed data

Real-time streaming

Architecture design

Apache Spark

Databricks

Cassandra

PostgreSQL

MySQL

Cloud: AWS/GCP/Azure

High-volume B2C

Regulatory compliance

ML/AI pipelines

Mentoring

Security & cost optimisation

Tools

Apache Spark

Databricks

Cassandra

PostgreSQL

MySQL

AWS

GCP

Azure

Job description

Global Tech is seeking a Principal Data Solution Architect to design and deliver distributed data platforms at scale for real-time digital experiences. You will architect streaming rails, data stores, and cloud-native solutions while collaborating with engineering teams to ensure scalable, compliant outcomes.

The role requires hands-on expertise with Spark, Databricks, Cassandra, and OLTP databases, with a focus on performance, security, and cost efficiency at high volumes.