Senior Data Engineer - Cloud Data Warehouses & ETL

Nishtech; Brussel Hoofdstad; Sur place; EUR 65 000 - 95 000; Plein temps

Résumé du poste

Nishtech BV is seeking an experienced Data Engineer to design, develop and optimize data pipelines and warehousing solutions. You will work with SQL Server, AWS Redshift, PostgreSQL, Spark, and PySpark to ingest, transform and load large datasets for reporting and analytics.

You will implement ETL frameworks, migrate on‑premise databases to cloud environments, and contribute to data modeling with Hive/HBase. Strong Python (Pandas) and BI tool experience are expected.

Qualifications

• 5–7 years of Data Engineering experience.
• Experience with data warehouses, marts using SQL Server, AWS Redshift, PostgreSQL.
• Expert knowledge of MongoDB NoSQL data modeling and admin tasks.
• Experience with Spark, PySpark, Spark SQL for ingestion and transformations.
• ETL development with Spark, Python (Pandas), Airflow.
• Migrations from on‑prem to cloud for SQL Server, PostgreSQL, MongoDB.
• SQL databases administration and development.
• Data visualization reports with Tableau, Power BI, SSRS.

Responsabilités

• Develop and maintain data warehouses and data marts with multiple business logics.
• Implement ETL pipelines using Spark and Python; load standardized data into Hive/HBase.
• Manage and administer PostgreSQL, SQL Server and AWS Redshift clusters.
• Migrate databases from on‑prem to cloud infrastructure.
• Build and optimize Spark jobs for large datasets using PySpark and Spark SQL.
• Create dashboards and reports using Tableau, Power BI, SSRS.

Connaissances

Data Engineering

SQL Server

AWS Redshift

PostgreSQL

Spark PySpark

ETL with Spark

Hive/HBase

Tableau/Power BI

Python (Pandas)

Airflow

Outils

pg_loader

bcp utility

timescaleDB

Description du poste

Nishtech BV is seeking an experienced Data Engineer to design, develop and optimize data pipelines and warehousing solutions. You will work with SQL Server, AWS Redshift, PostgreSQL, Spark, and PySpark to ingest, transform and load large datasets for reporting and analytics.

You will implement ETL frameworks, migrate on‑premise databases to cloud environments, and contribute to data modeling with Hive/HBase. Strong Python (Pandas) and BI tool experience are expected.