python developer for banking data quality

Astek; Warszawa; On-site; PLN 207,000 - 272,000; Full time

Benefits offered by this job

Multisport

Private medical care

Life insurance

Mentoring Center

Career path

Referral bonus 7000 PLN

Hybrid work (Warsaw, 2 office days)

Office in Warsaw

Job summary

HireHi ищет инженера по данным для разработки Python-приложений и бэкенда, создания конвейеров обработки данных в банковской среде. Ваша работа будет направлена на внедрение механизмов качества данных, настройку правил валидации и работу с SQL, BigQuery, Dataplex, Dataproc, Airflow.

Ожидается опыт работы с GCP, dbt и интеграции систем в облаке. Предоставляется гибридный формат работы в Варшаве, пакет преимуществ и ясная карьерная лестница.

Qualifications

• Глубокие знания Python и разработки бэкенда.
• Опыт работы с SQL и большими данными.
• Коммерческий опыт в проектах Data Quality.
• Опыт создания облачных решений на Google Cloud Platform (GCP).
• Знание сервисов: BigQuery, Dataplex, Dataproc, Cloud Composer/Airflow.
• Опыт проектирования конвейеров обработки данных.
• Опыт интеграции систем в облаке.
• Знание dbt и трансформаций данных.
• Опыт работы с GitHub и управление кодом.
• Знание Google Artifact Registry.

Responsibilities

• Разработка Python-приложений и бэкенда.
• Создание решений по обработке данных, валидации и качеству.
• Реализация механизмов Data Quality и правил валидации.
• Разработка SQL и рабочих процессов в BigQuery.
• Проектирование конвейеров обработки на GCP.
• Использование Dataplex, Dataproc, BigQuery, Airflow.
• Разработка трансформаций данных с dbt.
• Интеграция систем и источников данных в облаке.
• Анализ источников проблем качества данных.

Skills

Python

SQL

Data Quality

GCP

BigQuery

Dataplex

Dataproc

Airflow

dbt

GitHub

Artifact Registry

Banking sector

Tools

BigQuery

Dataplex

Dataproc

Airflow

dbt

GitHub

Artifact Registry

Job description

Описание:

The project is part of Initiative 4 of the DATA program, “Source Data Quality Assurance Mechanisms,” and contributes to the bank’s strategic data transformation. It aims to improve data quality when information is entered into banking systems and create a comprehensive data validation process on a new data platform.

Задачи:

• Design, implement, and develop Python applications and backend components
• Build solutions for data processing, validation, and quality control
• Implement Data Quality mechanisms and validation rules for data from source systems
• Create and optimize SQL and BigQuery queries and data processing workflows
• Design and develop data processing pipelines and workflows on Google Cloud Platform
• Use Dataplex, Dataproc, BigQuery, and Cloud Composer / Apache Airflow
• Build and develop data transformations using dbt
• Integrate systems and data sources in a cloud environment
• Analyze data quality issues and identify their sources in processes and systems

Требования:

• Strong practical knowledge of Python for independently designing, building, and developing applications and integration components
• Strong SQL skills and experience working with large datasets
• Commercial experience in Data Quality / data quality projects
• Practical experience designing and building cloud solutions on Google Cloud Platform (GCP)
• Strong knowledge of at least some of these services: Google BigQuery, Google Dataplex, Google Dataproc, Cloud Composer / Apache Airflow
• Experience designing systems and data processing workflows
• Experience creating and maintaining pipelines and system integrations
• Knowledge of dbt and practical experience building data transformations
• Experience with GitHub, version control, and code review
• Knowledge of Google Artifact Registry and application artifact management
• Будет плюсом: experience in the banking sector

Условия:

• Long-term cooperation
• Technical training, certifications, and professional development
• Membership in the Mentoring Competence Center from the first day, with opportunities to develop skills, attend conferences, and share knowledge and experience
• Clear career path
• Employee benefits package including Multisport, private medical care, and life insurance
• Friendly work atmosphere, integration events, and team-building meetings
• Referral system with a bonus of up to 7000 zl
• Hybrid work with 2 office days per week at the client’s office in central Warsaw
• Wynagrodzenie: od 1300 PLN netto/dzień, w zależności od posiadanego doświadczenia i kompetencji lub UOP jeżeli jesteś zainteresowany