End-to-End ETL Data Engineer: NiFi, Pipelines & Modelling

Wlgroup; Den Haag; On-site; EUR 70,000 - 110,000; Full time

Job summary

Wlgroup is seeking a Data Engineer in The Hague to design and build ETL processes that ingest imagery and reports from multiple networks, making flows controllable, observable and resilient. The role is delivered as milestones over a year by one engineer.

You will own pipelines end-to-end, from source data to target systems, with emphasis on configuration control, testing and operational readiness for production use.

Qualifications

• Hands-on experience with modern ETL tools such as Apache NiFi, Informatica, Talend or SSIS, ideally on AWS or Azure.
• Data modelling and transformation from heterogeneous sources.
• Experience with data sharing platforms, object stores and relational, NoSQL, graph and vector databases.
• Comfort on the Linux command line and a knack for fixing data anomalies.
• Experience delivering against fixed, deliverable-based contracts in multinational teams.
• Familiarity with NATO intelligence and surveillance architecture and applications, and fluent business English.

Responsibilities

• Documenting, configuring and testing the ETL requirements: source-to-target mapping, traceability and data reconciliation.
• Building data models, pipelines and schemas for data coming from many different sources.
• Putting configuration control in place: baselines, versioning, change approval and rollback.
• Setting up monitoring with metrics, alerts, dashboards and logging.
• Designing and testing resilience: backup and restore, failover, recovery time and point objectives.
• Troubleshooting production data flows, and handing over through a training package and on-the-job training for the administrators.

Skills

ETL tools

Data modeling

Data transformation

Linux CLI

Delivery against contracts

Business English

Tools

Apache NiFi

Informatica

Talend

SSIS

AWS

Azure

Job description

Wlgroup is seeking a Data Engineer in The Hague to design and build ETL processes that ingest imagery and reports from multiple networks, making flows controllable, observable and resilient. The role is delivered as milestones over a year by one engineer.

You will own pipelines end-to-end, from source data to target systems, with emphasis on configuration control, testing and operational readiness for production use.