Middle Data Engineer (#4296)

N-iX; Deutschland; Remote; EUR 60.000 - 80.000; Vollzeit

Zusammenfassung

A global software solutions provider is seeking a Middle Data Engineer to support the migration of legacy SQL Server data to a cloud-based Snowflake environment. The candidate will build and optimize data pipelines while collaborating with engineers. Strong SQL and Python skills are required, along with experience in cloud technologies like Snowflake and AWS S3. This role offers a flexible working format and a competitive salary.

Leistungen

Flexible working format

Competitive salary

Professional development tools

Active tech communities

Qualifikationen

• Experience with cloud data warehouse technologies, including Snowflake and AWS S3.
• Solid SQL skills; experience migrating legacy environments to cloud platforms.
• Proficiency in Python for data pipeline development.

Aufgaben

• Build and modify data pipelines to migrate data from SQL Server to AWS S3 and Snowflake.
• Refactor legacy ETL jobs for use in cloud environments.
• Optimize the performance and costs of cloud data processing.

Kenntnisse

Cloud data warehouse technologies

SQL

ETL frameworks

Python

Documentation skills

Tools

Snowflake

AWS S3

SSIS

dbt

Jobbeschreibung

N-iX is a global software solutions and engineering services company

Position Overview

As a Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment. The project involves integrating various data sources, refactoring ETL processes, and ensuring efficient, reliable data movement for analytics and reporting.

Responsibilities

• Build and modify data pipelines to migrate data from SQL Server and other databases (Azure SQL, Oracle, Aurora) to AWS S3 and Snowflake.
• Refactor legacy ETL jobs (SSIS, Transact-SQL) for use in cloud environments.
• Implement data transformations and staging using dbt and/or similar tools.
• Optimize the performance and costs of cloud data processing and storage.
• Work collaboratively with client’s and N-iX engineers, ensuring smooth handoff and documentation.
• Participate in QA, testing, deployment, and post-migration validation.

Must-Have Technologies

• Experience with cloud data warehouse technologies, including Snowflake and AWS S3.
• Solid SQL skills; experience migrating legacy environments to cloud platforms.
• Familiarity with ETL frameworks and tools (preferably SSIS, dbt).
• Proficiency in Python for data pipeline development and automation.
• Strong documentation and communication skills; able to work in cross-functional teams.

Nice to have

• Background working with varied database platforms (SQL Server, Oracle, PostgreSQL, MySQL).
• Knowledge of reporting platforms such as Looker is a plus.

We offer

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing

Project

Largest student transportation provider