Snowflake Data Engineer (Energy sector project)

Link Group; Poland; On-site; PLN 180,000 - 300,000; Full time

Job summary

Link Group poszukuje specjalisty Data Engineer Snowflake, który zaprojektuje i zaimplementuje skalowalne potoki danych w chmurze, dbając o modele danych i bezpieczeństwo. Doświadczenie w Snowflake w środowiskach produkcyjnych jest wymagane, wraz z umiejętnościami Python/Java/Scala i ETL/ELT.

Do zadań należy optymalizacja zapytań i współpraca z klientami oraz interesariuszami biznesowymi od analizy po utrzymanie produkcji.

Qualifications

• 4–7 lat doświadczenia zawodowego w Data Engineering, Big Data lub rozwoju Platform Danych w chmurze.
• Udokumentowane doświadczenie w dostarczaniu rozwiązań danych na poziomie przedsiębiorstwa.
• Doświadczenie z Snowflake w środowiskach produkcyjnych.
• Znajomość języków Python, Java lub Scala.
• Doświadczenie z ETL/ELT i integracją danych.
• Znajomość platform chmurowych i przetwarzania danych w rozproszonym środowisku.

Responsibilities

• Projektowanie, rozwijanie i optymalizacja potoków Snowflake w chmurze.
• Implementacja modeli danych, schematów, ról i zabezpieczeń Snowflake.
• Tworzenie i utrzymanie obiektów Snowflake: Tasks, Streams, Stages.
• Optymalizacja zapytań SQL i procesów przetwarzania danych pod kątem wydajności.
• Praca z narzędziami do integracji danych i nowoczesnymi frameworkami inżynierii danych.
• Współpraca ze sponsorami biznesowymi i zespołem technicznym w całym cyklu dostarczania rozwiązania.
• Udział w praktykach DevOps, automatyzacji i wdrożeń w środowiskach produkcyjnych.

Skills

Snowflake

SQL

Python

ETL/ELT

Data modelling

Cloud platforms

Agile methods

Communication

Tools

dbt

Matillion

Palantir

Informatica

Kafka

NiFi

AWS S3

AWS Lambda

AWS Glue

AWS EMR

Job description

O projekcie:

About the Role

As part of a Data & Analytics team, you will help organizations solve complex business challenges by designing and delivering modern data solutions. You will work with large-scale data platforms, cloud technologies, and advanced analytics environments to extract business value from data across multiple industries.

This role offers the opportunity to work on challenging data engineering projects, designing scalable cloud-based solutions and supporting clients in their data transformation journey.

Your Role

As a Snowflake Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines and warehouse solutions using Snowflake and cloud technologies. You will work across the full data delivery lifecycle, from data integration and modelling through development, testing, deployment, and production support.

You will collaborate with technical teams and business stakeholders to understand requirements, design effective solutions, and deliver high-quality data platforms.

Wymagania:

• Strong hands-on experience in Data Engineering and Data Warehousing.- Proven experience developing solutions using Snowflake.- Practical knowledge of Snowflake data modelling, including:- databases and schemas,- roles and permissions,- security policies.
• Experience working with Snowflake features such as:- Tasks,- Streams,- Stages.
• Strong SQL skills and experience working with large datasets.
• Experience with ETL/ELT development and data integration processes.
• Experience with cloud data platforms and distributed data processing concepts.
• Knowledge of programming languages such as Python, Java, or Scala.
• Understanding of data formats such as Parquet, ORC, and Avro.
• Experience with Agile delivery methodologies.
• Strong communication and problem-solving skills.
• Nice to Have- Experience with Snowflake performance tuning and resource management.
• Knowledge of data integration tools such as dbt, Matillion, Palantir, or Informatica.
• Experience with streaming and messaging technologies such as Kafka or NiFi.
• Experience with cloud services such as:- AWS S3,- AWS Lambda,- AWS Glue,- AWS EMR.
• Knowledge of DevOps practices and containerization technologies.
• Experience working directly with clients and business stakeholders.
• Experience Required- 4–7 years of professional experience in Data Engineering, Big Data, or Cloud Data Platform development.
• Proven experience delivering enterprise-scale data solutions.
• Experience working with Snowflake in production environments.
• Experience participating in full data solution delivery lifecycle, from design through deployment and support.

Codzienne zadania:

• Design, develop, and deploy scalable Snowflake data pipelines in cloud environments.
• Develop and optimize ETL/ELT processes, including migration of existing on-premise data workflows to cloud platforms.
• Design and implement Snowflake data models, including schemas, databases, roles, and security policies.
• Build and maintain Snowflake objects such as Tasks, Streams, and Stages.
• Optimize SQL queries, data models, and processing workflows for performance and scalability.
• Develop batch and real-time data processing solutions for structured and unstructured data.
• Work with data integration tools and modern data engineering frameworks.
• Collaborate with senior stakeholders to understand business requirements and translate them into technical solutions.
• Participate in the complete data solution lifecycle: analysis, design, development, testing, deployment, and production support.
• Contribute to DevOps practices, automation, and deployment processes.