Data Engineer

Luxoft; Polska; In loco; PLN 180.000 - 280.000; Tempo pieno

Vantaggi offerti da questo lavoro

Laptop and monitor

Descrizione del lavoro

Luxoft in Poland is seeking a Senior Snowflake Developer to design, build, and optimize scalable data solutions using Snowflake, DBT, and Python. You will translate requirements into robust data pipelines and ensure high performance across data flows.

Collaborate with architects, analysts, and stakeholders, implement CI/CD pipelines in Azure DevOps, enforce security best practices, and mentor peers. Prior experience with data warehouses and Data Vault 2.0 is a plus.

Competenze

• Master's degree in computer science, IT, or related field.
• 5+ years of data engineering experience, with Snowflake and DBT expertise.
• Proficient in writing complex SQL for large data volumes.
• Strong data warehousing knowledge and data modeling (OLTP/OLAP/Data Vault 2.0).
• Experience building data pipelines with DBT and CI/CD pipelines (Azure DevOps).
• Knowledge of performance tuning in Snowflake and security best practices.
• Excellent problem-solving, analytical, and communication skills.

Mansioni

• Design and develop Snowflake databases, schemas, and data layers (RAW/STG/MART).
• Manage access using RBAC, row/column level policies and security controls.
• Build data pipelines with Snowflake, Snowpipe, and batch loading.
• Create reliable production-grade Snowflake pipelines and optimize queries.
• Use Python for data processing, automation, and system integration.
• Develop and maintain ETL processes and complex data pipelines in Snowflake.
• Collaborate with architects, analysts, and stakeholders to design scalable data solutions.
• Automate DBT jobs and build CI/CD pipelines using Azure DevOps.
• Ensure data quality, integrity, and compliance across the lifecycle.
• Document data models, processes, and workflows; build data tests and mock data frameworks.
• Nice-to-have: AWS and Streamlit knowledge.

Conoscenze

SQL

Data modeling

Data warehousing

Problem solving

Communication

Teamwork

Formazione

Master’s degree in computer science/IT

Strumenti

Snowflake

DBT

Python

Azure DevOps

RBAC/Security

Snowpipe

AWS

Streamlit

Descrizione del lavoro

The project is for one of the world's famous science and technology companies in pharmaceutical industry, supporting initiatives in AWS, AI and data engineering, with plans to launch over 20 additional initiatives in the future. Modernizing the data infrastructure through the transition to Snowflake as a priority, as it will enhance capabilities for implementing advanced AI solutions and unlock numerous opportunities for innovation and growth.

We are seeking a Senior Snowflake Developer who will be responsible for designing, developing, and maintaining scalable data solutions that effectively meet the needs of our organisation.

The role will serve as a primary point of accountability for the technical implementation of the data flows, repositories and data-centric solutions in your area, translating requirements into efficient implementations.

Responsibilities:

• Design and work with Snowflake databases, schemas, views, and RAW, STG, and MART data layers.
• Manage access using RBAC, role hierarchies, row-level security, and column-level access policies.
• Work with dynamic tables, external stages, Snowpipe, and batch data loading.
• Build and support reliable, production-grade Snowflake data pipelines.
• Write optimised SQL queries for data extraction, transformation, and loading.
• Utilise Python for advanced data processing, automation tasks, and system integration.
• Be an advisor with your In-depth knowledge of Snowflake architecture, features, and best practices.
• Develop and maintain complex data pipelines and ETL processes in Snowflake.
• Collaborate with data architects, analysts, and stakeholders to design optimal and scalable data solutions.
• Automate DBT Jobs & build CI/CD pipelines using Azure DevOps for seamless deployment of data solutions.
• Ensure data quality, integrity, and compliance throughout the data lifecycle.
• Troubleshoot, optimize, and enhance existing data processes and queries for performance improvements.Document data models, processes, and workflows clearly for future reference and knowledge sharing.
• Build Data tests, Unit tests and mock data frameworks
• Good to have AWS and Streamlit knowledge

Mandatory Skills Description:

• Master’s degree in computer science, Information Technology, or a related field.
• 5+ years of overall experience in data engineering, including relevant and hands-on expertise in Snowflake and DBT.
• Extensive hands-on experience in writing complex SQL queries, demonstrating proficiency in data manipulation and analysis for large data volumes.
• Strong understanding of data warehousing concepts, methodologies, and technologies with in-depth experience in data modelling techniques (OLTP, OLAP, Data Vault 2.0)
• Experience building data pipelines using DBT (Data Build Tool) for data transformation.
• Familiarity with advanced techniques for performance tuning methodologies in Snowflake including query optimization.
• Strong knowledge with CI/CD pipelines, preferably in Azure DevOps.
• Excellent problem-solving, analytical, and critical thinking skills.
• Strong communication, collaboration, and interpersonal skills.

What do we offer our employees

Equipment, such as a laptop and monitor