Mid Data Platform Engineer

Talanto; Poland; Hybrid; PLN 151,000 - 212,000; Full time

Job summary

QED seeks a mid Data Platform Engineer to join our Warsaw team, building data pipelines and data-layer architectures to support public health and food security analytics across Africa. You will design, implement, and improve ETL/ELT systems, ensure reliability, and collaborate in cross-functional teams on scalable data solutions.

The role requires UNIX-based development, strong English skills, and a willingness to work in a multicultural, mission-driven environment with a hybrid work model in

Qualifications

• Experience designing and maintaining data pipelines with ETL/ELT.
• Ability to structure data systems into raw, cleaned, curated layers.
• Experience deciding between batch, micro-batch, and streaming approaches based on latency and correctness.
• Strong software engineering background with testing discipline.
• Ability to communicate clearly across cultures and teams.

Responsibilities

• Design and implement data infrastructure to support analytics and product features.
• Collaborate in design sessions and code reviews with cross-functional teams.

Skills

ETL/ELT pipelines

Data pipeline reliability

Unix-based platforms

English (C1+)

Software architecture

Code reviews

Tools

Python

Django

DBT

Dagster

Luigi

ClickHouse

Docker

Terraform

Kubernetes

Nix

Job description

13,500 – 19,000 PLN

Important: if an employer asks you to log into their system via iCloud or Google, send a code, an SMS or Telegram password, run some code, or install software — refuse. These are signs of fraud.

QED is a tech company focused on public health and food security in Sub-Saharan Africa. We build the digital infrastructure and AI used at the intersection of aid and scientific inquiry, including surveillance of HIV/malaria/TB, and nutrient analysis of crops and soils, working at national-scale in several African countries. Our funding comes from multiple philanthropic and governmental organizations, including the Global Fund, Gates Foundation, and the CDC.

We are looking for a mid Data Platform Engineer to join our team in Warsaw. Desired skills include:

• experience designing and maintaining data pipelines using ETL and/or ELT approaches, with the ability to reason about trade-offs rather than defaulting to a single pattern
• understanding of data pipeline reliability concepts, including idempotency, backfills, and handling late or corrected data
• ability to structure data systems into clear layers (e.g. raw, cleaned, curated) and reason about their different purposes and guarantees
• experience deciding between batch, micro-batch, and streaming approaches based on latency, correctness, and operational complexity
• strong background in software engineering, version control, writing readable code and tests, robust design, and basic data structures and algorithms
• ability to conceive logical software architectures and express yourself clearly, both verbally and in writing
• willingness to tackle a wide array of problems and technologies
• willingness to participate in regular design sessions, code reviews, and working in teams
• development primarily on UNIX-based or OSX-Darwin platforms
• working proficiency (≥C1) in speaking, reading, and typing English (≥45 words per minute)
• willingness and interest in working with people from other cultures
• emotional resilience and social intelligence
• and you have to care about the work that you do
• and you have to be optimistic at least sometimes, although pessimism tends to be useful

Bonus skills (not required)

• understanding of analytical data modeling concepts, including how to transform raw data into analytics-ready datasets and define clear data semantics for downstream consumers
• experience with Python, Django, DBT, Dagster, Luigi or Clickhouse
• experience with containerization (Docker), Terraform, Kubernetes or Nix
• knowledge and experience with data warehousing, online analytical processing, metadata management, dimensional modeling, and relational database theory
• experience with programming and/or math competitions
• product-oriented mindset
• willingness to go on an adventure
• domain knowledge and/or interest in the sustainable development goals, particularly in public health, agriculture, and assisting developing countries

What can you expect

• unusual, socially conscious projects
• a mix of product, internal platform, and client integration work
• ability and encouragement to explore technologies other than your main expertise
• optional travel to learn more about problems we're trying to solve

Requires a full-time commitment physically based in Warsaw, Poland, with a hybrid of remote and in-person work throughout the week. We expect at least 2-3 days per week in the office. The working hours are flexible, for example you do not need approval to take out a small chunk in the middle of the day to handle some personal business.