Data Engineer (Scala) – Data Assets

Allegro.eu S.A.; Kraków; Hybrid; PLN 163,000 - 232,000; Full time

Benefits offered by this job

Well-located offices with amenities

MacBook Pro or Dell laptops with full配

Job summary

Allegro.eu S.A. is seeking Data Engineers to build scalable data processing for millions of Allegro customers. You will work on batch and realtime pipelines, leveraging GCP services like DataProc, Dataflow, BigQuery and related tooling in a hybrid Polish setup.

You will collaborate with over 150 engineers across multiple teams, apply clean code, CI/CD, and participate in ongoing learning and AI-driven projects.

Qualifications

• Proficiency in Scala/Java and Python for data processing tasks.
• Strong understanding of distributed systems and data pipelines.
• Knowledge of GCP or other cloud platforms (Azure/AWS).
• Experience with CI/CD, clean code practices, and TDD.
• Experience with Unix/Linux and English at B2 level.

Responsibilities

• Build highly scalable and fault-tolerant data processing for Allegro users.
• Work with batch and streaming pipelines on Google Cloud Platform services.
• Collaborate with data scientists and engineers to deploy ML models.
• Follow best practices in code reviews, testing and automation.

Skills

Scala

Java

Python

Tools

Kubernetes

Docker

Consul

GitHub

GitHub Actions

Job description

Flexible working hours in the hybrid model (4/1) - working hours start between 7:00 a.m. and 10:00 a.m. We also have 30 days of occasional remote work.

The salary range for this position depending on the skill set is as follows (contract of employment, tax-deductible cost): PLN gross 14 600 - 20 825

Annual bonus based on your annual performance and company results.

Our team is based in Warsaw and Cracow.

About the team:

As part of the Data & AI area, we implement projects based on the practical "data science" and "artificial intelligence" applications of an unprecedented scale in Poland. Data & AI is a group of over 150 experienced engineers organized into over a dozen teams with various specializations. Some of them build dedicated tools for creating and launching BigData processes or implementing ML models for the entire organization. Others work closer to the client and are responsible for the implementation of the search engine, creating recommendations, building a buyer profile or developing an experimental platform. There are also research teams in the area whose aim is to find solutions to non-trivial problems requiring the use of machine learning.

We are looking for Data Engineers who want to build highly scalable and fault-tolerant data processing for millions of Allegro customers. The platform processes (batch and realtime) 5 billion clickstream events every day (up to 150k / sec, ) from all Allegro sites and Allegro mobile applications. This is a hybrid solution using Google Cloud Platform (GCP) services like DataProc, GKE, Beam, BigQuery, Pubsub or Dataflow (scio).

We are looking for people who:

Are programming in languages such as Scala or Java, Python

Have strong understanding of distributed systems, data storage and processing framework like dbt, Spark or Apache Beam

Have knowledge of GCP (especially Dataproc, Dataflow and Composer) or other public cloud environments like Azure or AWS

Use good practices (clean code, code review, TDD, CI/CD)

Navigate efficiently within Unix/Linux systems

Possess a positive attitude and team-working skills

Are eager for personal development and keeping their knowledge up to date

Know English at B2 level

What's in it for you:

Well-located offices (with e.g. fully equipped kitchens, bicycle parking, terraces full of greenery) and excellent work tools (e.g., raised desks, ergonomic chairs, interactive conference rooms).

A 16" or 14" MacBook Pro or corresponding Dell with Windows (if you don't like Macs) and all the necessary accessories.

A wide selection of fringe benefits in a cafeteria plan - you choose what you like (e.g., medical, sports or lunch packages, insurance, purchase vouchers).

English classes that we pay for related to the specific nature of your job.

A training budget, inter-team tourism (see more here ), hackathons, and an internal learning platform where you will find multiple trainings.

An additional day off for volunteering, which you can use alone, with a team, or with a larger group of people connected by a common goal.

Social events for Allegro people - Spin Kilometers, Family Day, Fat Thursday, Advent of Code, and many other occasions we enjoy.

And that's just the beginning! You can read more about the benefits here .

#goodtobehere means that:

You will join a team you can count on - we work with top-class specialists who have knowledge- and experience-sharing in their DNA.

You will love our level of autonomy in team organization, the space for continuous development, and the opportunity to try new things. You get to choose which technology solves the problem and you are responsible for what you create.

You will value our Developer Experience and the full platform of tools and technologies that make creating software easier. We rely on an internal ecosystem based on self-service and widely used tools such as Kubernetes, Docker, Consul, GitHub, and GitHub Actions. Thanks to this, you can contribute to Allegro from your very first days on the job.

You will be equipped with modern AI tools to automate repetitive tasks, allowing you to focus on developing new services and refining existing ones (also leveraging AI support).

You will create solutions that will be used (and loved!) by your friends, family and millions of our customers.

You will meet the Allegro Scale, which starts with over 1000 microservices, an open-source data bus (Hermes) with 300K+ rps, a Service Mesh with 1M+ rps, tens of petabytes of data, and production-used machine learning.

You will become part of Allegro Tech - We speak at industry conferences, cooperate with tech communities, run our own blog (it's been over 10 years!), record podcasts, lead guilds, and we organize our own internal conference - the Allegro Tech Meeting. We create solutions we love (and can) to talk about!

Don’t wait until you join us! Let’s meet online!

Get to know our team, take a peek at our office life and check out what else we do at Allegro.