Senior Data Engineer

Vivid Resourcing Ltd; Amsterdam; On-site; EUR 122,000 - 149,000; Full time

Benefits offered by this job

Work trips to Asia

European office locations

Job summary

Vivid Resourcing Ltd in Amsterdam is seeking a Senior Data Engineer to own the design, build, and maintenance of data pipelines, data warehouses, and related infrastructure essential for data-driven decision making.

You will take ownership or lead junior engineers, help recruit to the team, and develop leadership skills while shaping data architecture across the organization.

Qualifications

• Proven experience in data engineering or a related role.
• Proficiency in data integration, ETL, and data warehousing.
• Experience with databases, data modeling, real-time data, and SQL optimization.
• Familiarity with data orchestration tools like Apache Airflow.
• Knowledge of cloud platforms AWS and GCP.

Responsibilities

• Design, build, and maintain scalable data pipelines to collect, process, and transform data from multiple sources into a usable format.
• Manage and optimize the data warehouse to ensure high performance, availability, and data integrity.
• Integrate and consolidate data from multiple sources, including databases, APIs, and external data providers.
• Create and maintain ETL processes to move, clean, and transform data for analysis and reporting.
• Implement data quality checks and monitoring processes to identify and rectify data inconsistencies or anomalies.
• Monitor and optimise data pipelines and databases for performance, scalability, and reliability.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet their needs.
• Lead or mentor junior engineers and assist recruitment.

Skills

Data engineering

ETL processes

Data warehousing

SQL optimization

Airflow

AWS

GCP

Leadership

Communication

Tools

Apache Airflow

AWS

GCP

Job description

My client in Amsterdam are hiring for a Senior Data Engineer on a permanent basis. You will be responsible for the development and maintenance of our data pipelines, data warehouses, and other data-related infrastructure. Your role will be crucial in ensuring that data is collected, processed, and made available for analysis, enabling data-driven decision-making across the organisation.

The opportunity allows you take ownership or leading junior engineers and help recruit to the team and developing your leadership skills.

Key Responsibilities

• Design, build, and maintain scalable and efficient data pipelines to collect, process, and transform data from various sources into a usable format.
• Manage and optimise our data warehouse to ensure high performance, availability, and data integrity.
• Integrate and consolidate data from multiple sources, including databases, APIs, and external data providers.
• Create and maintain ETL processes to move, clean, and transform data for analysis and reporting purposes.
• Implement data quality checks and monitoring processes to identify and rectify data inconsistencies or anomalies.
• Monitor and optimise data pipelines and databases for performance, scalability, and reliability.
• Collaborate with data analysts, data scientists, and other stakeholders to understand data requirements and deliver solutions that meet their needs.

Your profile

• Proven experience in data engineering or a related role.
• Proficiency in data integration, ETL processes, and data warehousing.
• Experience with database technologies, data modeling, real-time data and SQL query optimization.
• Familiarity with data orchestration and workflow management tools (e.g., Apache Airflow).
• Knowledge of cloud platforms (e.g., AWS, GCP) and their data services.
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork skills.
• Ability to work in a fast-paced, diverse, dynamic environment and adapt to changing priorities.

Salary Package

• Up to €135,000 per annum (D.O.E)
• Annual work trip to asia
• Possibility to work from different offices around Europe