Platform Engineer

Startup Atlas; Amsterdam; Hybrid; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Stock option package

Job summary

Polars is hiring a Platform Engineer to contribute to the Polars Cloud platform and the distributed query engine. You will design gRPC/REST APIs, implement leader election and failover for cluster nodes, and manage replication of distributed query state.

You will work in a hybrid role based in Amsterdam, collaborating with the cloud platform and compute engine teams to build a scalable, high-performance data processing stack for both cloud and on-prem deployments.

Qualifications

• Familiar with Linux and able to navigate manpages without help.
• Proficient in async Rust (Tokio) with practical experience, preferably building services.
• Familiar with distributed systems architecture and implementation.
• Prefers simple solutions but knows when complex ones are required.
• Enjoys working across domains in a small team and thriving in a startup.
• Interest in stock option packages and long-term growth in a high-growth startup.

Responsibilities

• Design gRPC and REST APIs for the Polars Cloud platform.
• Implement leader election and failover for cluster nodes.
• Handle replication of distributed query state across nodes.
• Collaborate closely with cloud platform and compute engine teams.

Skills

Linux

Rust (async)

Distributed systems

Team collaboration

Stock options

Tools

gRPC

REST APIs

Job description

Pola develops Polars, an open-source high-performance DataFrame library written in Rust, along with Polars Cloud, a managed solution for scaling data workloads.

As a platform engineer at Polars, you will work on fundamental components of the Polars Cloud platform and distributed query engine, including designing APIs, leader election, and failover for cluster nodes. You will cooperate closely with the cloud platform and compute engine teams in a hybrid role based in Amsterdam.

Job Description

• On-site, Hybrid
• Amsterdam, Noord-Holland, Netherlands

As a platform engineer at Polars you cross many domains & optimizations to make our (distributed) engine efficient & stable.

Polars is the next generation of DataFrames. We don’t take the easy route and build from the ground up, controlling every element allows us to create a superior solution. Our open-source implementation is one of the fastest growing data projects on GitHub and has over 30 thousand stars and 100 million downloads to date.

We believe data processing should be a seamless experience from working locally on your development machine to an enterprise production environment. There should be one framework to learn for data practitioners, removing the need for rewriting code when going to production. To make that possible, we are building a cloud platform to seamlessly bring locally developed Polars pipelines to production. We are also building a distributed engine for Polars to scale beyond the limits of a single machine, both in the cloud and on-premises.

How will you make an impact?

You will be working on fundamental components of both the Polars Cloud platform and the Polars distributed query engine. Some of the things you will be working on are designing gRPC / REST api’s, leader election and failover for cluster nodes, replication of distributed query state and more. For these problems, you will cooperate closely with the cloud platform and compute engine teams.

Job requirements

• You are familiar with Linux and can find what you need in manpages
• You are proficient in async Rust (Tokio)
• You are familiar with distributed systems architecture and implementation
• You prefer simple solutions to complex ones, but know when complex solutions are needed
• You enjoy working across different domains in a small team
• An important role in a high-growth startup allowing plenty of growth opportunities in diverse directions
• Chance to work with and learn from a small strong technical team passionate about data processing and software engineering
• Stock option package

We're looking for someone who can join us in our Amsterdam office twice a week to collaborate with the team, drive faster development and ideation, and help build our team culture.