Senior Snowflake Data Engineer

Luxoft; Kraków; On-site; PLN 167,400 - 223,200; Full time

Job summary

Luxoft is seeking a data engineer in Kraków, Poland, to work on projects for a leading global pharmaceutical company. The role emphasizes expertise in Snowflake for data warehousing and requires strong SQL skills. Candidates should have 5+ years of experience in data engineering and be proficient in optimizing data integration and collaboration features within Snowflake.

The position demands effective communication and the ability to work closely with various teams to ensure high-quality data solutions. The company also seeks candidates familiar with ETL/ELT tools and AWS services.

Qualifications

• 5+ years of experience in data engineering or related field.
• Strong proficiency in Snowflake's capabilities.
• Experience in performance tuning of SQL queries.

Responsibilities

• Develop and optimize complex SQL scripts and data transformations.
• Implement and maintain data models and dimensional modeling.
• Monitor and troubleshoot performance issues in Snowflake.

Skills

Snowflake (Snowpipe, RBAC, performance tuning)

Complex SQL queries

ETL/ELT tools

Data security and compliance

Documentation and coaching

Python proficiency

Tools

Azure DevOps

DBT

AWS Glue

Fivetran

Job description

Project Description

The project is for one of the world's famous science and technology companies in the pharmaceutical industry, supporting initiatives in AWS, AI and data engineering, with plans to launch over 20 additional initiatives in the future. Modernizing the data infrastructure through the transition to Snowflake as a priority, it will enhance capabilities for implementing advanced AI solutions and unlock numerous opportunities for innovation and growth.

Responsibilities

• In-depth knowledge of Snowflake's data warehousing capabilities.
• Understanding of Snowflake's virtual warehouse architecture and how to optimize performance and cost.
• Proficiency in using Snowflake's data sharing and integration features for seamless collaboration.
• Develop and optimize complex SQL scripts, stored procedures, and data transformations.
• Work closely with data analysts, architects, and business teams to understand requirements and deliver reliable data solutions.
• Implement and maintain data models, dimensional modeling for data warehousing, data marts, and star/snowflake schemas to support reporting and analytics.
• Integrate data from various sources including APIs, flat files, relational databases, and cloud services.
• Ensure data quality, data governance, and compliance standards are met.
• Monitor and troubleshoot performance issues, errors, and pipeline failures in Snowflake and associated tools.
• Participate in code reviews, testing, and deployment of data solutions in development and production environments.

Skills

Must have

• 5+ years of experience
• Strong proficiency in Snowflake (Snowpipe, RBAC, performance tuning).
• Ability to write complex SQL queries, stored procedures, and user-defined functions.
• Skills in optimizing SQL queries for performance and efficiency.
• Experience with ETL/ELT tools and techniques, including Snowpipe, AWS Glue, openflow, fivetranor similar tools for real-time and periodic data processing.
• Proficiency in transforming data within Snowflake using SQL, with Python being a plus.
• Strong understanding of data security, compliance and governance.
• Experience with DBT for database object modeling and provisioning.
• Experience in version control tools, particularly Azure DevOps.
• Good documentation and coaching practice.

Nice to Have

• Experience with AWS Lambda, particularly in utilizing Python to develop data extraction functionalities.
• Ability to retrieve data from platforms like SharePoint or Salesforce and transfer it to an S3 bucket.