Data Engineer: Cloud Platform for Fusion Energy

Sigma Software; Województwo mazowieckie; On-site; PLN 180,000 - 260,000; Full time

Job summary

Sigma Software is guiding a fusion energy research initiative and seeking a Data Engineer to build scalable cloud-native data platforms for analytics and experimentation. You will work with Databricks, Spark, AWS, and Azure in a research-forward environment.

Collaborating with scientists and engineers, you will enable analytics, ML workflows, data governance, and robust data pipelines while focusing on quality, lineage, and cost efficiency.

Qualifications

• 3+ years of commercial experience in Data Engineering
• 2+ years of hands-on production experience with Databricks
• Strong expertise with Delta Lake, including medallion architecture and table optimization
• Advanced proficiency in Python, pySpark, and SQL
• Deep practical knowledge of Databricks components including Unity Catalog, Lakeflow Jobs / Workflows, and job optimization
• Hands-on experience with AWS services including S3, IAM, KMS, and at least one of AWS Batch, ECR, EventBridge, Lambda, or API Gateway
• Experience designing event-driven and asynchronous data pipelines
• Strong knowledge of Infrastructure as Code and CI/CD practices
• Practical experience with MLflow, experiment tracking, model registry, and reproducibility practices
• Strong understanding of data quality, lineage, schema contracts, and provenance concepts
• Experience with data quality frameworks such as Great Expectations, Soda, pyDeequ, or Databricks DQX
• Experience monitoring and optimizing data platform reliability and cloud costs
• Upper-Intermediate or higher English level

Responsibilities

• Design, develop, and maintain scalable and reliable data platforms and pipelines for analytics and operational use cases
• Build distributed data processing workflows using Apache Spark, pySpark, and Databricks
• Develop and evolve cloud-native data solutions leveraging Azure and AWS services
• Model and optimize data structures for analytics, reporting, and downstream consumption
• Integrate data from multiple heterogeneous sources while ensuring data quality, consistency, and traceability
• Implement data quality controls, schema validation, lineage tracking, and monitoring processes
• Optimize performance, scalability, reliability, and cost-efficiency of data pipelines and infrastructure
• Collaborate closely with scientists, analysts, and engineering teams to translate business and research requirements into technical solutions
• Contribute to CI/CD processes, infrastructure automation, and engineering best practices
• Research and introduce new technologies and approaches within the data engineering ecosystem

Tools

Databricks

Delta Lake

Unity Catalog

Lakeflow Jobs/Workflows

Python

pySpark

SQL

Spark

AWS S3

IAM

KMS

AWS Batch

ECR

EventBridge

Lambda

API Gateway

Terraform

Databricks Asset Bundles

Git

CI/CD

OIDC

service principals

MLflow

Great Expectations

Soda

pyDeequ

Databricks DQX

Unity Catalog

Terraform

Databricks Asset Bundles

Job description

Sigma Software is guiding a fusion energy research initiative and seeking a Data Engineer to build scalable cloud-native data platforms for analytics and experimentation. You will work with Databricks, Spark, AWS, and Azure in a research-forward environment.

Collaborating with scientists and engineers, you will enable analytics, ML workflows, data governance, and robust data pipelines while focusing on quality, lineage, and cost efficiency.