data engineer in data platforms

Sytac BV; Amsterdam; On-site; EUR 90,000 - 140,000; Full time

Benefits offered by this job

Unlimited Growth Days

Company laptop budget €4000

Technology budget

Training budget €2400/year

Pension contribution 3.75%

Annual team events / ski trips

No relocation support

Job summary

Sytac ищет senior data engineer в Амстердаме для разработки производственных ETL/ELT пайплайнов на Python и SQL. Ваша задача — проектирование Lakehouse сред и управление инфраструктурой как кодом с использованием Terraform и Docker/Kubernetes.

Вы будете работать с Airflow, Databricks, GCP/Azure и обеспечивать качество данных. Требуется 6+ лет опыта, сильный английский, знание Spark/PySpark, SQL и опыт работы с Azure Databricks и CI/CD.

Qualifications

• 6+ лет опыта в production‑софтвере
• Высшее/магистр уровня мышления HBO/WO
• Эксперт в Python и SQL в PostgreSQL/MSSQL/Oracle
• Глубокий опыт Spark/PySpark для распределённых задач
• Опыт с Azure Databricks, Data Factory, Synapse и/или GCP BigQuery/Dataflow
• Опыт Lakehouse и моделирования Star/dimension
• Опыт оркестрации Airflow
• Опыт Git/Azure DevOps pipelines и CI/CD
• Опыт Docker и Kubernetes на ежедневной основе
• Опыт Kafka и Elasticsearch
• Опыт обеспечения качества данных, lineage и governance
• Опыт в AI‑assisted разработке
• Сильное взаимодействие с стейкхолдерами
• Хороший английский
• Желателен: Scala/Java/Kotlin, Dutch, dbt, Terraform/Bicep, Medallion, Delta, Iceberg, Hudi, ArgoCD, OpenAI

Responsibilities

• Строить поддерживаемые, модульные ETL/ELT пайплайны на Python, PySpark и SQL
• Проектировать Lakehouse среды с Medallion архитектурой
• Владеть infrastructure как кодом через Terraform/Bicep
• Контейнеризация через Docker и Kubernetes
• Оркестрация рабочих процессов с Apache Airflow
• CI/CD для пайплайнов через Azure DevOps и GitHub Actions
• Использовать AI‑инструменты в разработке и интегрировать LLM
• Преобразовывать бизнес‑логику в технические спецификации
• Поддерживать точную lineage и governance

Skills

Python

SQL

Spark/PySpark

Airflow

Azure Databricks

Data Lake / Lakehouse

Git / CI/CD

Docker / Kubernetes

English

Education

HBO/WO уровень мышления

Tools

Azure Databricks

Azure Data Factory

Synapse / BigQuery

GCP Dataflow

Airflow

Docker

Kubernetes

Git / Azure DevOps

Kafka

Elasticsearch

Job description

Описание:

Sytac provides data platforms for some of the Netherlands' largest companies, including KLM, ABN AMRO, ING, Rabobank, Bol, and Ahold. The company operates in software development, data infrastructure and analytics, and IT consulting.

Задачи:

• Build maintainable, modular, tested, and versioned ETL/ELT pipelines in Python, PySpark, and SQL
• Design Lakehouse environments using Medallion architecture and dimensional/Star Schema modelling on Azure and GCP
• Own infrastructure as code with Terraform or Bicep and containerized deployments on Docker and Kubernetes
• Orchestrate data workflows with Apache Airflow
• Run CI/CD for data pipelines using Azure DevOps and GitHub Actions
• Use AI tools in the development workflow and integrate LLMs into pipelines where appropriate
• Translate business logic into clear technical specifications
• Set the quality bar through code quality
• Maintain accurate data lineage and governance.

Требования:

• 6+ Years of experience building production software
• HBO/WO level of thinking
• Expert Python and SQL across PostgreSQL, MSSQL, and Oracle
• Deep Apache Spark/PySpark experience for distributed processing
• Experience with pandas or polars
• Experience with Azure Databricks, Data Factory, and Synapse, and/or GCP BigQuery and Dataflow
• Experience with Lakehouse/Data Lake environments and Star/dimensional modelling
• Experience with Apache Airflow orchestration
• Experience with Git, Azure DevOps Pipelines, and CI/CD for data pipelines
• Daily experience with Docker and Kubernetes
• Experience with Kafka and Elasticsearch
• Experience with data quality, lineage, and governance
• Experience with AI-assisted development
• Strong stakeholder management and ability to translate business needs into technical solutions
• Strong English
• NL residency required; expats must already be living and working in the Netherlands; Nice to have: Scala, Java, Kotlin, Dutch, dbt, FastAPI, Terraform/Bicep, Medallion, Delta, Iceberg, Hudi, GitHub Actions, Helm, ArgoCD, Kafka, Debezium, Azure Event Hub/Service Bus, GCP Pub/Sub, Snowflake, AWS Glue/Athena, OpenAI/Azure OpenAI, LLM integration in pipelines, MDM, reference data.

Условия:

• Unlimited Growth Days for professional development and Sytac activities
• Private laptop under €4,000 with 50% paid by the company
• Technology budget
• €2,400 Annual growth budget for training and conferences
• Company contribution of 3.75% to the pension
• Annual ski trips, beach BBQs, and parties
• No relocation support is offered.