Data Engineer

Zypp; Rotterdam; On-site; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Modern workplaces

Growth opportunities

Central Rotterdam location

Job summary

Zypp in Rotterdam is seeking a Data Engineer to design, build, and deploy data infrastructure for the company and clients. You will set up data pipelines, data lakes and data warehouses, and develop robust data models.

You will work with ERP sources, APIs, various file formats, and even unstructured data to prepare data for reporting. You will use Azure, IaC and CI/CD to create automated, scalable environments and collaborate with other teams to meet project requirements.

Qualifications

• Experience designing data pipelines, data lakes and data warehouses.
• Strong knowledge of Azure data services and cloud infrastructure.
• Ability to work with APIs, ERP sources, and unstructured data such as PDFs.
• Experience with Python and SQL for data modeling and transformations.

Responsibilities

• Designing, building, and deploying data infrastructure for Zypp and clients.
• Setting up data pipelines, data lakes/warehouses, and data models.
• Developing and maintaining data models and ensuring data quality.
• Collaborating with other teams to meet technical requirements and project goals.

Skills

Azure

Python

SQL

Data pipelines

CI/CD

APIs

Web scraping

LLM integration

Cloud data platforms

Tools

Azure Platform

Docker

GitHub Actions

Terraform

Synapse Analytics

SQL Server

Job description

As a Data Engineer at Zypp, you are responsible for designing, building, and deploying our data infrastructure or that of our clients. You work on setting up data pipelines, setting up data lakes or data warehouses, and developing and maintaining data models. You feel comfortable accessing data from various sources, ERP systems, via APIs, various file formats, and unstructured data such as PDFs or via web scraping. You have thorough knowledge of Cloud in the field of data, Python, SQL, and setting up data pipelines. Bonus: experience with LLM models and integrating them into business processes, using APIs from larger providers such as OpenAI and Anthropic.

Solving complex issues where data needs to be accessed from sources, cleaned, prepared, and analyzed, and ultimately prepared for reporting or further analysis.

Designing and building data infrastructure in Azure for various projects, using Infrastructure as Code (IaC) and CI/CD.

You ensure the setup of automated and scalable environments and work together with other teams to ensure that the data infrastructure meets the technical requirements of the assignment.

Independently setting up and executing data projects, including developing data pipelines, data warehousing, and data modeling.

Developing and managing data models for projects and solutions for clients.

Exploring new technological possibilities and applying them to further improve our offerings.

Who you are

You have a passion for setting up data infrastructure to help organizations use their data as simply as possible.

You are eager to learn and open to mastering new subjects.

You have relevant experience in the above-mentioned topics, or experience in similar domains and are willing to learn the mentioned topics.

You have experience developing data solutions in Azure, experience with SQL Server, Container Instances, Azure Functions, Synapse Analytics, Azure Fabric, Azure Storage, and Azure OpenAI is a plus.

You can create and implement logical data models that align with the specific needs of the client and the project.

You have a good understanding of Python, developing structured projects, writing professional code, OOP, and testing code.

You have knowledge of SQL and are able to write and optimize queries.

Technology and tools you'll use

Azure Platform for hosting infrastructure and building serverless solutions, including SQL Server, Azure Container Instances, Azure Functions, Azure Storage, and Synapse Analytics

Python and SQL for solution development

Docker and GitHub actions for CI/CD

Git and Github

TerraForm

Benefits of working at Zypp!

Zypp is located in a prime location in Rotterdam, next to the central station (Groothandelsgebouw) in the CIC - the place to be for innovation with more than 150 startups! We also offer modern workplaces with the latest hardware, from laptop to screen, mouse and keyboard. You work together with colleagues who are just as enthusiastic as you and that ensures not only professional, but also personal growth.

At Zypp we are always looking for innovation. So if there's a better solution, we implement it right away. That's one of the benefits of working at a fast-growing startup!