Remote Data Engineer: Scala & Spark on GCP

DAC.digital Group; Województwo pomorskie; Hybrid; PLN 262,000 - 357,000; Full time

Benefits offered by this job

Remote work option

On-site optional at Gdańsk office

Job summary

DAC.digital Group is expanding and partnering with a leading provider of financial market infrastructure, seeking a senior data engineer to design and implement scalable data processing solutions using Scala and Apache Spark.

You will build and optimize cloud-based data pipelines on Google Cloud Platform, work with Databricks and Zeppelin notebooks, and lead data engineering initiatives in an Agile environment, collaborating with stakeholders across the business.

Qualifications

• Strong experience with Scala and Apache Spark for designing and developing distributed data processing solutions.
• Hands-on experience with Databricks and Zeppelin Notebooks in data engineering and analytics projects.
• Proficiency in Google Cloud Platform (GCP) services for scalable cloud-based data solutions.
• Advanced SQL knowledge for complex querying, data modeling, and performance tuning.
• Experience building, scheduling, and monitoring ETL pipelines using Apache Airflow.
• Knowledge of Jira and Confluence for agile delivery, project tracking, and documentation management.
• Knowledge of English (B2); proven leadership in technical teams; stakeholder management; strong communication and collaboration.

Responsibilities

• Design, develop, and maintain scalable data processing solutions using Scala and Apache Spark.
• Build and optimize data pipelines and ETL workflows in cloud environments on Google Cloud Platform.
• Develop and maintain data engineering solutions using Databricks and Zeppelin Notebooks.
• Write, optimize, and troubleshoot complex SQL queries to support business and analytics needs.
• Orchestrate, schedule, and monitor data workflows using Apache Airflow.
• Ensure data quality, reliability, and performance across data platforms.
• Collaborate with cross-functional teams to gather requirements and deliver data-driven solutions.
• Participate in code reviews, testing, and continuous improvement of data engineering best practices.
• Document technical solutions and project deliverables in Confluence.
• Support agile delivery processes through Jira for task management and collaboration.

Skills

Scala

Apache Spark

Databricks

Zeppelin Notebooks

Google Cloud Platform

SQL

Apache Airflow

Jira

Confluence

Leadership

Stakeholder management

Agile methodologies

Communication skills

English (B2)

Tools

Databricks

Zeppelin Notebooks

Jira

Confluence

Google Cloud Platform (GCP)

Job description

DAC.digital Group is expanding and partnering with a leading provider of financial market infrastructure, seeking a senior data engineer to design and implement scalable data processing solutions using Scala and Apache Spark.

You will build and optimize cloud-based data pipelines on Google Cloud Platform, work with Databricks and Zeppelin notebooks, and lead data engineering initiatives in an Agile environment, collaborating with stakeholders across the business.