A global software solutions company is seeking a Senior/Middle Data Engineer to support the migration of legacy data warehouses to a cloud-based Snowflake environment. Responsibilities include building data pipelines, refactoring ETL processes, and optimizing cloud storage performance. Candidates should have solid SQL skills, experience with cloud technologies like Snowflake and AWS S3, and proficiency in Python. Remote and flexible working options are available.
Leistungen
Flexible working format
Competitive salary
Professional development tools
Active tech communities
Qualifikationen
Experience with cloud data warehouse technologies, including Snowflake and AWS S3.
Solid SQL skills; experience migrating legacy environments to cloud platforms.
Familiarity with ETL frameworks and tools (preferably SSIS, dbt).
Proficiency in Python for data pipeline development and automation.
Aufgaben
Build and modify data pipelines to migrate data from SQL Server and other databases to AWS S3 and Snowflake.
Refactor legacy ETL jobs for use in cloud environments.
Implement data transformations and staging using dbt.
Optimize the performance of cloud data processing and storage.
Work collaboratively with client’s and N-iX engineers.
Participate in QA, testing, deployment, and post-migration validation.
Kenntnisse
Cloud data warehouse technologies
SQL
ETL frameworks and tools
Python
Documentation and communication skills
Tools
Snowflake
AWS S3
SSIS
dbt
Jobbeschreibung
N-iX is a global software solutions and engineering services company
Position Overview:
As a Senior/Middle Data Engineer, you will support the migration of legacy on-premises SQL Server data warehouse to a cloud-based Snowflake environment. The project involves integrating various data sources, refactoring ETL processes, and ensuring efficient, reliable data movement for analytics and reporting.
Responsibilities:
Build and modify data pipelines to migrate data from SQL Server and other databases (Azure SQL, Oracle, Aurora) to AWS S3 and Snowflake.
Refactor legacy ETL jobs (SSIS, Transact-SQL) for use in cloud environments.
Implement data transformations and staging using dbt and/or similar tools.
Optimize the performance and costs of cloud data processing and storage.
Work collaboratively with client’s and N-iX engineers, ensuring smooth handoff and documentation.
Participate in QA, testing, deployment, and post-migration validation.
Must-Have Technologies
Experience with cloud data warehouse technologies, including Snowflake and AWS S3.
Solid SQL skills; experience migrating legacy environments to cloud platforms.
Familiarity with ETL frameworks and tools (preferably SSIS, dbt).
Proficiency in Python for data pipeline development and automation.
Strong documentation and communication skills; able to work in cross-functional teams.
Nice to have:
Background working with varied database platforms (SQL Server, Oracle, PostgreSQL, MySQL).
Knowledge of reporting platforms such as Looker is a plus.
We offer*:
Flexible working format - remote, office-based or flexible
A competitive salary and good compensation package
Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
Active tech communities with regular knowledge sharing
* Der Gehaltsbenchmark wird auf Basis der Zielgehälter bei führenden Unternehmen in der jeweiligen Branche ermittelt und dient Premium-Nutzer:innen als Richtlinie zur Bewertung offener Positionen und als Orientierungshilfe bei Gehaltsverhandlungen. Der Gehaltsbenchmark wird nicht direkt vom Unternehmen angegeben. Er kann deutlich über bzw. unter diesem Wert liegen.