Senior Data Engineer: Azure Databricks & AI Pipelines

Sii Poland; Szczecin; On-site; PLN 180,000 - 240,000; Full time

Job summary

A leading biotech firm in Poland is seeking a seasoned Data Engineer to build and optimize analytics pipelines using Python or Scala. You'll collaborate with data scientists and engineers to create innovative data systems on Microsoft Azure, leveraging technologies like Hadoop and Spark. The ideal candidate will have senior-level experience in data engineering, a strong command of coding skills, and proficiency in English and Polish. Join this transformative biotech project and shape the future of biotechnology.

Benefits

Great Place to Work

Solid financial situation

Contracts with major brands

Internal training center

Expert mentorship

Open management

Profit sharing

Passion Sponsorship program

Integration events

Comfortable offices

Medical care

Qualifications

• Senior-level experience in data engineering, specifically in building analytics pipelines.
• Strong proficiency in Python or Scala, with hands-on SQL experience.
• Familiarity with big data technologies such as Hadoop, Hive, or Spark.
• Solid understanding of data modeling and security best practices.
• Experience with Azure technologies, including Azure Databricks and Azure Data Factory.
• Proficiency in English at B2 level or higher.
• Fluent Polish and residency in Poland required.

Responsibilities

• Build and optimize advanced analytics data pipelines using Python or Scala.
• Implement scalable solutions with big data technologies like Hadoop or Spark.
• Design secure, high-performance data architectures on Microsoft Azure.
• Collaborate with teams to develop proof-of-concept solutions and innovative applications.

Skills

Python

Scala

SQL

Hadoop

Hive

Spark

Azure

Data modeling

Data security

Tools

Azure Databricks

Azure Data Factory

Azure Storage

Azure Stream Analytics

SQL Server

Azure Key Vault

Azure Functions

GitHub

Azure DevOps

Job description

A leading biotech firm in Poland is seeking a seasoned Data Engineer to build and optimize analytics pipelines using Python or Scala. You'll collaborate with data scientists and engineers to create innovative data systems on Microsoft Azure, leveraging technologies like Hadoop and Spark. The ideal candidate will have senior-level experience in data engineering, a strong command of coding skills, and proficiency in English and Polish. Join this transformative biotech project and shape the future of biotechnology.