Senior Data Engineer – Healthcare Data Platform

Sigmasoftware2; Poland; On-site; PLN 180,000 - 260,000; Full time

Job summary

Sigmasoftware2 is seeking an experienced data infrastructure engineer to design and implement scalable data pipelines and cloud infrastructure. You will collaborate with product owners to define schemas and ETL processes, and build self-service tooling for data platforms.

Responsibilities include optimizing large datasets, implementing Terraform-based infrastructure, and working with Azure, Snowflake, and Databricks.

Qualifications

• Hands-on experience with cloud computing services in data and analytics.
• Experience with data modeling, reporting tools, data governance, and data warehousing.
• Proficiency in Python and PySpark for distributed data processing.
• Experience with Azure, Snowflake, and Databricks.
• Experience with Docker and Kubernetes.
• Knowledge of infrastructure as code (Terraform).
• Advanced SQL skills and familiarity with big data databases such as Snowflake, Redshift, etc.
• Experience with stream processing technologies such as Kafka, Spark Structured Streaming.
• At least an Upper-Intermediate level of English.

Responsibilities

• Collaborate with the Product Owner and team leads to define and design efficient pipelines and data schemas
• Build and maintain infrastructure using Terraform for cloud platforms
• Design and implement large-scale cloud data infrastructure, self-service tooling, and microservices
• Work with large datasets to optimize performance and ensure seamless data integration
• Develop and maintain squad-specific data architectures and pipelines following ETL and Data Lake principles
• Discover, analyze, and organize disparate data sources into clean, understandable schemas

Skills

Cloud computing

Python

PySpark

Data modeling

SQL

Data warehousing

Data governance

English (Upper-Intermediate)

Tools

Azure

Snowflake

Databricks

Docker

Kubernetes

Terraform

Kafka

Spark Structured Streaming

Job description

Sigmasoftware2 is seeking an experienced data infrastructure engineer to design and implement scalable data pipelines and cloud infrastructure. You will collaborate with product owners to define schemas and ETL processes, and build self-service tooling for data platforms.

Responsibilities include optimizing large datasets, implementing Terraform-based infrastructure, and working with Azure, Snowflake, and Databricks.