Senior Data Scientist: AI-Driven Data Pipelines & Spark

BELVEDERE; Kraków; Hybrid; PLN 180,000 - 260,000; Part time

Job summary

BELVEDERE in Krakow is seeking a Senior Data Scientist to design, build, and operate scalable batch and streaming data pipelines. You will work with distributed processing frameworks and AI-assisted development tools to deliver cloud-based data solutions and governance-enabled data workflows.

The role involves collaborating with Analytics and Platform Engineers, leveraging GCP services, and driving data quality and BI use cases. Hybrid work setup in Krakow is offered for a six-month contract.

Qualifications

• 4-6 years of experience in data engineering or related field.
• Strong experience with Apache Airflow and distributed data processing frameworks like Apache Spark.
• Proficiency in Python and SQL for data pipeline development.
• Mandatory familiarity with AI-assisted coding tools for day-to-day development.
• Experience with GCP data services for managing cloud-based data solutions.
• Knowledge of data transformation tools such as dbt.
• Experience with streaming systems for real-time data processing.
• Exposure to data quality or governance tooling.
• Familiarity with analytics or business intelligence use cases.
• Understanding of Apache Beam for batch and streaming data processing.

Responsibilities

• Design and build scalable batch and streaming data pipelines.
• Implement distributed data processing using Apache Spark and Apache Beam.
• Orchestrate workflows with Apache Airflow to ensure efficient data management.
• Develop and maintain data transformations using SQL and dbt.
• Collaborate with Analytics Engineers and Platform Engineers on project execution.
• Enhance data processing capabilities through AI-driven workflows.
• Support business intelligence needs through analytics-driven use cases.
• Improve data integrity using quality and governance tooling.

Skills

Python

SQL

AI-assisted coding tools

GCP familiarity

Tools

Apache Spark

Apache Beam

Apache Airflow

dbt

Job description

BELVEDERE in Krakow is seeking a Senior Data Scientist to design, build, and operate scalable batch and streaming data pipelines. You will work with distributed processing frameworks and AI-assisted development tools to deliver cloud-based data solutions and governance-enabled data workflows.

The role involves collaborating with Analytics and Platform Engineers, leveraging GCP services, and driving data quality and BI use cases. Hybrid work setup in Krakow is offered for a six-month contract.