data engineer for scalable data platforms

Enfint; Wrocław; On-site; PLN 102,000 - 122,000; Full time

Benefits offered by this job

LuxMed

MyBenefit credits

Multisport

Glasses reimbursement

Referral bonuses

AI tools licenses

R&D lab access

Job summary

Vention ищет опытного инженера по данным для проектирования и поддержки масштабируемых конвейеров ETL/ELT на облачных платформах. Ваша работа будет включать интеграцию источников данных, обеспечение качества и доступности для аналитики и ML, а также создание Data Lake, Data Warehouse и Data Lakehouse.

Требуется 4+ года опыта, продвинутые навыки Python/SQL, опыт Spark/PySpark и работы с AWS или Azure. Вакансия предполагает работу в кросс-функциональных командах и акцент на Agile и англ.

Qualifications

• 4+ года опыта в Data Engineering и создании end-to-end data solutions.
• Знания Python/SQL на продвинутом уровне.
• Опыт работы с Apache Spark/PySpark в распределённых средах.

Responsibilities

• Строить, оптимизировать и поддерживать масштабируемые ETL/ELT пайплайны на облаке.
• Интегрировать источники данных, обеспечивать качество и доступность для аналитики и ML.
• Разрабатывать облачные архитектуры данных: Data Lake, Data Warehouse, Data Lakehouse.
• Разрабатывать решения обработки данных с использованием Spark/PySpark.

Skills

Python

SQL

Spark/PySpark

Cloud experience

Data Lake/Warehouse

Agile/Scrum

English B2+

Tools

AWS

Azure

Job description

Описание:

Vention is a global engineering partner to tech leaders and fast-growing startups, combining over 20 years of product development expertise with an AI-first approach. The company helps startups and enterprises turn data into smart decisions and better user experiences by building scalable data pipelines and infrastructure.

Задачи:

• Build, optimize, and maintain scalable ETL/ELT pipelines using cloud platforms;
• Integrate and manage diverse data sources, ensuring data quality, reliability, and accessibility for analytics and ML use cases;
• Design and maintain cloud-native data architectures, including Data Lake, Data Warehouse, and Data Lakehouse;
• Develop data processing solutions using Spark and PySpark in distributed environments;
• Collaborate with cross-functional teams to translate business requirements into efficient, scalable data solutions;
• Support analytics use cases by enabling data consumption for reporting, dashboards, and visualization tools;
• Stay up to date with modern data platform technologies and best practices, contributing to continuous improvement of the data ecosystem.

Требования:

• 4+ Years of experience in Data Engineering, delivering end-to-end data solutions;
• Strong hands-on experience with Python and SQL;
• Solid expertise with Apache Spark and PySpark for distributed data processing;
• Hands-on experience with AWS, including Glue, S3, Athena, and QuickSight, or Azure, including Data Factory, Databricks, and ADLS;
• Good understanding of modern data architectures, including Data Lake, Delta Lake, and Data Warehouse;
• Experience working in an Agile environment, such as Scrum or Kanban;
• English B2+, comfortable communicating with English-speaking customers.

Условия:

• Salary from 10010 PLN gross;
• Private medical care with LuxMed;
• Kafeteria MyBenefit credits for stores, restaurants, and cafés;
• Access to a Multisport membership;
• Glasses reimbursement program;
• Referral bonuses for bringing in new talent;
• EDU corporate community with tech communities, interest clubs, events, an R&D lab, a knowledge base, and a dedicated AI track;
• Licenses for AI tools, including GitHub Copilot and Cursor.