Cloud Data Engineer for Fusion Energy Platform

Sigma Software; Warszawa; On-site; PLN 170,000 - 250,000; Full time

Job summary

Sigma Software is seeking a Data Engineer to help build scalable cloud-native data platforms for a deep-tech fusion energy research initiative. You will work with Databricks, Spark, AWS and Azure to enable analytics, experimentation, and ML workflows.

Join a team of scientists and engineers in a highly innovative R&D environment focusing on data quality, provenance, and cost-efficient cloud architectures while advancing sustainable energy research.

Qualifications

• 3+ years of commercial experience in data engineering.
• 2+ years production experience with Databricks.
• Strong Python, PySpark, and SQL skills.
• Experience with AWS services such as S3, IAM, KMS.
• Knowledge of IaC and CI/CD practices.
• Experience with MLflow and experiment tracking.
• Understanding of data quality, lineage, and provenance concepts.

Responsibilities

• Design, develop, and maintain scalable data platforms and pipelines for analytics and operational use cases.
• Build distributed data processing workflows using Apache Spark, PySpark, and Databricks.
• Develop and evolve cloud-native data solutions leveraging Azure and AWS services.
• Model and optimize data structures for analytics, reporting, and downstream consumption.
• Integrate data from multiple heterogeneous sources while ensuring data quality, consistency, and traceability.
• Implement data quality controls, schema validation, lineage tracking, and monitoring processes.
• Collaborate closely with scientists, analysts, and engineering teams to translate business and research requirements into technical solutions.
• Contribute to CI/CD processes, infrastructure automation, and engineering best practices.
• Research and introduce new technologies and approaches within the data engineering ecosystem.

Skills

Databricks

Delta Lake

PySpark

Python

SQL

AWS

CI/CD

Terraform

Git

MLflow

Data Quality

Tools

Databricks Unity Catalog

Lakeflow Jobs

Terraform

Git workflows

CI/CD tooling

Job description

Sigma Software is seeking a Data Engineer to help build scalable cloud-native data platforms for a deep-tech fusion energy research initiative. You will work with Databricks, Spark, AWS and Azure to enable analytics, experimentation, and ML workflows.

Join a team of scientists and engineers in a highly innovative R&D environment focusing on data quality, provenance, and cost-efficient cloud architectures while advancing sustainable energy research.