Senior Data Lakehouse Architect

Be | Shaping the Future Poland; Poland; Remote; PLN 180,000 - 260,000; Full time

Job summary

Be | Shaping the Future Poland is seeking a Senior Data Lakehouse Architect & Data Engineering Consultant to design and deploy scalable cloud data solutions. You will lead data pipelines, model data using Medallion Architecture, and drive governance and quality across Azure and Google Cloud platforms.

The role demands deep hands-on experience with Databricks, Spark, Delta Lake, Unity Catalog, and strong Python/SQL skills. Remote work from Poland is supported, with ASAP start.

Qualifications

• 10+ years of experience in Data Engineering, Data Architecture, or similar roles.
• Experience in the financial services sector, preferably with trading or clearing data.
• Strong hands-on experience with Azure and/or GCP, including Databricks, Spark, Delta Lake, and Unity Catalog.
• Proficiency in Python, SQL, and PySpark.
• Experience with Data Lakehouse, Data Mesh, data governance, and data modelling.
• Hands-on experience with Kafka, Terraform, Ansible, CI/CD, and workflow orchestration tools.
• Knowledge of modern data formats such as Parquet, Avro, Delta, and Iceberg.

Responsibilities

• Design and implement scalable Data Lakehouse solutions on Azure and/or GCP.
• Develop batch and streaming data pipelines using Databricks, Spark, PySpark, Python, and SQL.
• Design data models and implement Medallion Architecture (Bronze, Silver, Gold).
• Build and maintain data governance, metadata management, and data quality processes.
• Develop event-driven architectures using Kafka, AMQP, or similar technologies.
• Automate deployments using Terraform, Ansible, CI/CD, and orchestration tools such as Airflow or Azure Data Factory.
• Provide technical leadership and collaborate with Agile teams to deliver scalable cloud data solutions.

Skills

Data Lakehouse

Data Architecture

Azure

GCP

Databricks

Spark

Delta Lake

Unity Catalog

Python

SQL

PySpark

Data Governance

Data Modelling

Kafka

Terraform

Ansible

CI/CD

Airflow

Azure Data Factory

Parquet

Avro

Delta

Iceberg

Tools

Databricks

Spark

Delta Lake

Unity Catalog

Kafka

Terraform

Ansible

CI/CD

Airflow

Azure Data Factory

Parquet

Avro

Delta

Iceberg

Job description

Be | Shaping the Future Poland has a proven position of being a reliable partner for financial services organisations to analyse complex requirements, find solutions and implement them in their entirety, regardless of their complexity. Since the foundation of Be Poland in 2013, we have been continually expanding and customising our spectrum of services. Today, we are privileged to have in our team the best individuals in each sector we operate within the financial services industry.

Senior Data Lakehouse Architect & Data Engineering Consultant

Location: Remote from Poland

Start Date: ASAP

Contract Type: B2B

Responsibilities

• Design and implement scalable Data Lakehouse solutions on Azure and/or GCP.
• Develop batch and streaming data pipelines using Databricks, Spark, PySpark, Python, and SQL.
• Design data models and implement Medallion Architecture (Bronze, Silver, Gold).
• Build and maintain data governance, metadata management, and data quality processes.
• Develop event-driven architectures using Kafka, AMQP, or similar technologies.
• Automate deployments using Terraform, Ansible, CI/CD, and orchestration tools such as Airflow or Azure Data Factory.
• Provide technical leadership and collaborate with Agile teams to deliver scalable cloud data solutions.

Requirements

• 10+ years of experience in Data Engineering, Data Architecture, or similar roles.
• Experience in the financial services sector, preferably with trading or clearing data.
• Strong hands‑on experience with Azure and/or GCP, including Databricks, Spark, Delta Lake, and Unity Catalog.
• Proficiency in Python, SQL, and PySpark.
• Experience with Data Lakehouse, Data Mesh, data governance, and data modelling.
• Hands‑on experience with Kafka, Terraform, Ansible, CI/CD, and workflow orchestration tools.
• Knowledge of modern data formats such as Parquet, Avro, Delta, and Iceberg.

Our offer:

• Competitive remuneration on B2B contract
• Option to activate Medicover and Multisport on preferential terms
• Access to Mindgram - mental health & well-being platform
• Free gym at Q22