Cloud Data Platform Engineer — Real-Time Streaming

The BDPN; Greater London; Hybrid; GBP 68,000 - 113,000; Full time

Job summary

Chainalysis is seeking a Data Platform Engineer to design, build, and optimize scalable data platforms with a focus on streaming data, cloud infrastructure, and automation. The role involves creating CI/CD pipelines, integrating data clouds with databases, and enforcing observability and governance across data pipelines.

The ideal candidate has 3+ years in data platform or infrastructure roles, strong AWS and Terraform skills, and experience with Kafka, Flink, Spark, and related lakehouse

Qualifications

• 3+ years of experience as a Data Platform Engineer or Software Engineer or Infrastructure Engineer, with hands-on expertise in building and maintaining cloud-based data platforms.
• Solid experience with AWS services, a good understanding of cloud architecture, and proficiency with Terraform for provisioning and managing cloud infrastructure
• Experience building streaming data pipelines using Apache Flink, Apache Kafka, Spark Structured Streaming, or similar technologies
• Knowledge of modern data lakehouse architectures and ecosystem such as Kafka, Flink, Spark, Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, and comfort with Python/Java and SQL
• Experience with networking and security concepts within AWS, including VPCs, subnets, routing, security groups, IAM, etc.

Responsibilities

• Design, develop, and optimize high-performance, scalable data platforms with a strong focus on streaming data processing, large data volumes, and cloud infrastructure
• Implement and maintain infrastructure automation and self-service using Terraform, ensuring reliable environments for development and production
• Build seamless integrations between Data Cloud and various relational and noSQL OLTP databases
• Design and build frameworks and abstractions to accelerate development of data pipelines while embedding data engineering best practices
• Establish and maintain observability, security, and data governance solutions to ensure high quality and reliability of data pipelines

Skills

AWS

Terraform

Streaming data

Python/Java

SQL

Tools

Apache Kafka

Apache Flink

Spark

Databricks

DBT

Job description

Chainalysis is seeking a Data Platform Engineer to design, build, and optimize scalable data platforms with a focus on streaming data, cloud infrastructure, and automation. The role involves creating CI/CD pipelines, integrating data clouds with databases, and enforcing observability and governance across data pipelines.

The ideal candidate has 3+ years in data platform or infrastructure roles, strong AWS and Terraform skills, and experience with Kafka, Flink, Spark, and related lakehouse