Platform Engineer (Rust)

Polars; Amsterdam; Hybrid; EUR 60.000 - 80.000; Full time

Job summary

A high-growth startup in Amsterdam is seeking a skilled developer proficient in async Rust to work on their innovative cloud platform and distributed query engine. You'll design APIs and tackle challenges in cluster management while collaborating with a passionate technical team. This role offers an important opportunity for growth, competitive salary, stock options, and flexible hours, aimed at enhancing team collaboration and building a strong company culture in the office twice a week.

Benefits

Growth opportunities

Collaboration with a strong technical team

Competitive salary

Stock option package

Flexible working hours

Qualifications

• Proficient in async Rust, particularly with the Tokio framework.
• Familiarity with distributed systems architecture and implementation.
• Experience using Linux and navigating manpages.

Responsibilities

• Work on Polars Cloud platform and distributed query engine.
• Design gRPC / REST APIs.
• Collaborate with teams for cluster node management.

Skills

Proficiency in async Rust (Tokio)

Familiarity with distributed systems architecture

Linux proficiency

Preference for simple solutions

Job description

Polars

Polars is the next generation of DataFrames. We don’t take the easy route and build from the ground up, controlling every element allows us to create a superior solution. Our open-source implementation is one of the fastest growing data projects on GitHub and has over 30 thousand stars and 100 million downloads to date.

We believe data processing should be a seamless experience from working locally on your development machine to an enterprise production environment. There should be one framework to learn for data practitioners, removing the need for rewriting code when going to production. To make that possible, we are building a cloud platform to seamlessly bring locally developed Polars pipelines to production. We are also building a distributed engine for Polars to scale beyond the limits of a single machine, both in the cloud and on-premises.

How will you make an impact?

You will be working on fundamental components of both the Polars Cloud platform and the Polars distributed query engine. Some of the things you will be working on are designing gRPC / REST api’s, leader election and failover for cluster nodes, replication of distributed query state and more. For these problems, you will cooperate closely with the cloud platform and compute engine teams.

• You are familiar with Linux and can find what you need in manpages

• You are proficient in async Rust (Tokio)

• You are familiar with distributed systems architecture and implementation

• You prefer simple solutions to complex ones, but know when complex solutions are needed

• You enjoy working across different domains in a small team

Benefits

• An important role in a high-growth startup allowing plenty of growth opportunities in diverse directions

• Chance to work with and learn from a small strong technical team passionate about data processing and software engineering

• Competitive salary

• Stock option package

• Flexible working hours

We're looking for someone who can join us in our Amsterdam office twice a week to collaborate with the team, drive faster development and ideation, and help build our team culture.