Data Engineer: GCP Data Pipelines & Streaming

Fireart; Warszawa; On-site; PLN 170,000 - 250,000; Full time

Benefits offered by this job

Competitive compensation

Long-term collaboration

Open environment

Flexible collaboration

Job summary

Fireart is seeking a Data Engineer to design, develop, and optimize our data infrastructure on Databricks and GCP. You will architect scalable ETL/ELT pipelines using BigQuery, Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and data quality.

You will collaborate with Data Science, Analytics, and Product teams; implement CI/CD for data components; use Docker and Kubernetes for microservices; and uphold governance with GDPR/CCPA compliance.

Qualifications

• 3+ years of professional experience in data engineering.
• Strong experience with BigQuery environments and Google Cloud Storage data lakes.
• Proficiency in Apache Airflow for scheduling and ETL/ELT design.
• Experience with dbt transformations and data quality tooling.

Responsibilities

• Define and implement the data architecture on GCP, including data warehousing in BigQuery/Databricks.
• Build and optimize ETL/ELT pipelines using Airflow, dbt, Dataflow, and Pub/Sub.
• Implement event-driven or asynchronous data workflows between microservices.
• Establish CI/CD pipelines for data components and maintain infrastructure as code with Terraform.
• Collaborate with Data Science, Analytics, and Product teams to support analytics and ML initiatives.

Skills

BigQuery

Databricks

Airflow

dbt

Python/Java/Scala

GCP

Data quality

Data architecture

Tools

Terraform

RabbitMQ

Docker

Kubernetes

Jenkins

GitLab CI

Ansible

Job description

Fireart is seeking a Data Engineer to design, develop, and optimize our data infrastructure on Databricks and GCP. You will architect scalable ETL/ELT pipelines using BigQuery, Airflow, dbt, Dataflow, and Pub/Sub, ensuring high availability and data quality.

You will collaborate with Data Science, Analytics, and Product teams; implement CI/CD for data components; use Docker and Kubernetes for microservices; and uphold governance with GDPR/CCPA compliance.