Data engineer

Inetum; Warszawa; Hybrid; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Flexible working hours

Hybrid work model

Cafeteria benefits

Referral bonus up to PLN6,000

Team-building budget

Participation in charitable activities

Job summary

Inetum Polska ищет специалиста по данным для построения и сопровождения комплексных пайплайнов и фреймворков для обработки данных. Ваша работа будет включать сбор данных из разных источников в Data Lake и обеспечение высокого качества данных.

Требуется опыт в SQL, Python, Linux и работу с Hadoop/Spark/Kafka. Гибридный формат и возможность обучения и сертификаций в рамках компании.

Qualifications

• Требуется опыт в управлении качеством данных и данные оперативной обработки.
• Знание ETL процессов и принципов обработки данных.
• Опыт работы с облачными сервисами (GCP) приветствуется.

Responsibilities

• Строить и поддерживать процессы сбора данных из разных источников в Data Lake.
• Проектировать, развивать и оптимизировать конвейеры данных и фреймворки.
• Разрабатывать тестовые наборы и тестовые фреймворки для пайплайнов.
• Сотрудничать с аналитиками и дата-сайентистами для поставки качественных данных.
• Обеспечивать безопасность, соответствие и управление данными.

Skills

Data governance

Data quality management

CI/CD pipelines

Metadata management

Real-time data processing

Education

Bachelor’s or Master’s degree in Data Science, Statistics, Computer Science, Economics, or related field

Tools

SQL

PL/SQL

Python

Linux

Bash scripting

Cloudera Hadoop

Apache Spark

Apache Kafka

Job description

Описание:

Inetum Polska is part of the global Inetum Group and plays a key role in driving the digital transformation of businesses and public institutions. Operating in cities such as Warsaw, Poznan, Katowice, Lublin, Rzeszow the company offers a wide range of IT services. Inetum Polska actively supports employee development by fully funding training, certifications, and participation in technology conferences.

Задачи:

Building and maintaining processes for collecting data from various sources into the Data Lake. Designing, developing, and optimizing complex data pipelines to ensure reliable data flow. Creating, developing, and maintaining frameworks that facilitate the construction of data pipelines. Implementing comprehensive testing frameworks for data pipelines. Collaborating with analysts and data scientists to ensure the delivery of high-quality data. Ensuring robust data management, security, and compliance practices. Researching and implementing new technologies to improve data pipeline performance. Leveraging and integrating data from various types of source systems, including Kafka, MQ, SFTP, databases, APIs, and file shares.

Требования:

Proficiency in cloud platforms and services- GCP. Bachelor’s or Master’s degree in Data Science, Statistics, Computer Science, Economics, or a related field. Minimum 3 years of experience as a Data Analyst or Data Quality Analyst in a data-driven organization. Proven experience in data quality management and data governance practices. Strong database expertise, including advanced SQL and PL/SQL. Proficiency in Python. Experience with Linux and bash scripting. Solid understanding of Cloudera Hadoop technology stack (Apache Spark, Apache Kafka). Knowledge of data handling principles, including ETL processes and real-time data processing. Будет плюсом: experience in Scala; Experience with CI/CD pipelines and automation tools; Strong understanding of data governance principles, including metadata management and data quality frameworks; Ability to work with and understand various source system types (Kafka, MQ, SFTP, databases, APIs, file shares)

Условия:

Flexible working hours. Hybrid work model, allowing employees to divide their time between home and modern offices in key Polish cities. A cafeteria system that allows employees to personalize benefits by choosing from a variety of options. Generous referral bonuses, offering up to PLN6,000 for referring specialists. Dedicated team-building budget for online and on-site team events. Opportunities to participate in charitable initiatives and local sports programs. A supportive and inclusive work culture with an emphasis on diversity and mutual respect. Hybrid work- 3 times a week from the office in Warsaw.