Senior Data Platform Engineer: Build Scalable Data Lakes

Globaldevgroup; Polska; On-site; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Comfortable environment

20 vacation days

Top-notch equipment

HR support

Job summary

Globaldevgroup is seeking a Senior Data Platform Engineer to design, build, and evolve our data infrastructure. You will develop scalable ingestion pipelines, shape the data lake, and enable analytics, AI workloads, and large-scale model execution.

You will work hands-on with Kubernetes, Terraform, and data orchestration tools like Airflow or Prefect, building reliable, high-volume data platforms that power product applications and analytics.

Qualifications

• 5+ years of experience as a Data Platform/Infra Engineer.
• Proven track record of building and operating scalable data infrastructure within Data Lake architectures.
• Experience designing and operating large-scale data processing workloads on Kubernetes, including workload autoscaling with KEDA.
• Strong proficiency in Python and SQL.
• Hands-on experience with Infrastructure as Code, preferably Terraform.
• Experience with managing a data orchestration platform such as Airflow or Prefect.
• Experience with Snowflake.

Responsibilities

• Build complex, high-volume batch and near-real-time ingestion services.
• Design and implement data solutions for a distributed microservices environment.
• Develop and optimize large-scale data pipelines for batch and streaming use cases.
• Ensure data quality, compliance, and governance.
• Manage and optimize Kubernetes infrastructure, utilizing KEDA to scale resources.
• Own the full lifecycle of the data stack using Terraform and Kubernetes, from provisioning to application-level frameworks.
• Provide technical guidance for the team and drive best practices around infra, CI/CD, testing, and system design.
• Dive into memory management and performance tuning for cost-effective, fast distributed systems.

Skills

Python

SQL

Tools

Kubernetes

Terraform

Airflow

Prefect

Snowflake

Job description

Globaldevgroup is seeking a Senior Data Platform Engineer to design, build, and evolve our data infrastructure. You will develop scalable ingestion pipelines, shape the data lake, and enable analytics, AI workloads, and large-scale model execution.

You will work hands-on with Kubernetes, Terraform, and data orchestration tools like Airflow or Prefect, building reliable, high-volume data platforms that power product applications and analytics.