Staff Data Platform Engineer — PB-scale Data Transfer Hub

Icehouseventures; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

Icehouseventures in London seeks a Staff Data Platform Engineer to lead the Data Transfer Hub project, facilitating the transfer of a large volume of sensor data from partner vehicles. This hands-on role requires deep expertise in building scalable data pipelines with a hands-on cloud platform experience, particularly in Azure.

The ideal candidate will have a passion for AI technology, a product mindset, and thrive in a dynamic startup environment. Icehouseventures promotes a hybrid working model to foster innovation and collaboration.

Qualifications

• Proven experience building and operating large-scale data transfer pipelines.
• Strong proficiency in Python and Terraform for building data systems.
• Experience with cloud platforms, preferably Azure.

Responsibilities

• Set technical direction for the Data Transfer Hub, making trade-offs across various factors.
• Lead the technical design and delivery of the data transfer project.
• Design and build distributed data transfer pipelines for global partners.

Skills

Large-scale data transfer pipelines

Parallelised transfer jobs

Cloud platform skills (Azure preferred)

Python

Terraform

Networking experience

Tools

Flyte

Kafka

Job description

Icehouseventures in London seeks a Staff Data Platform Engineer to lead the Data Transfer Hub project, facilitating the transfer of a large volume of sensor data from partner vehicles. This hands-on role requires deep expertise in building scalable data pipelines with a hands-on cloud platform experience, particularly in Azure.

The ideal candidate will have a passion for AI technology, a product mindset, and thrive in a dynamic startup environment. Icehouseventures promotes a hybrid working model to foster innovation and collaboration.