Senior Data Engineer - Azure & Databricks (Onsite)

Optiveum; Wrocław; On-site; PLN 136,000 - 227,000; Full time

Job summary

Optiveum is seeking a Senior Data Engineer to join a data team in the financial services arm of a global automotive company. You will build and optimize ETL pipelines in Azure and Databricks, migrate legacy data, ensure data quality and collaborate with cross-functional teams to deliver actionable insights.

The role requires 5+ years in data engineering, strong SQL and Python/Java/Scala skills, plus Azure Databricks expertise and relevant certifications.

Qualifications

• 5+ years in data engineering or related field with ETL/cloud data tools.
• Bachelor’s degree in Computer Science, Engineering or related field; Master’s preferred.
• Microsoft Certified Azure Data Engineer and Databricks Certified Data Engineer.
• Proficiency in Python, Java or Scala.
• Hands-on experience with MS Cloud SQL Server, Azure Data Factory, Azure Databricks, PySpark, Spark SQL, ADLS, Power BI, SSIS and SSRS.
• Strong SQL skills and experience with relational databases.
• Familiarity with big data technologies and data processing frameworks.
• Experience with Agile/Scrum.
• Strong problem-solving and communication skills and a collaborative mindset.
• English at C1 level

Responsibilities

• Extract, standardize, transform and load data from multiple sources to deliver clean datasets for analysis, including legacy migrations.
• Collaborate with data modellers and business analysts to map data models and source-to-staging mappings.
• Create analysis-ready data structures and DDLs for MS Cloud SQL Server tables and views in the Pond database.
• Develop Databricks notebooks to extract data and form Shared File Formats (SFFs).
• Configure Ingestion Framework tables to load staging and DLC tables.
• Build large-scale batch and real-time data pipelines in cloud/on-prem environments; optimize performance.
• Apply CI/CD practices and automate integration flows.
• Monitor data consumption and coordinate with governance teams on the data catalogue.
• Drive improvements in data acquisition, testing and tooling to raise quality.
• Monitor and optimize SQL queries; prepare design documents from requirements.
• Work in cross-functional agile teams and contribute to estimates.

Skills

Python/Java/Scala

SQL

Agile/Scrum

English(C1)

Education

Bachelors in Computer Science/Engineering or related

Master's preferred

Tools

Azure Databricks

Azure Data Factory

MS Cloud SQL Server

Spark SQL

ADLS

Power BI

SSIS/SSRS

Job description

Optiveum is seeking a Senior Data Engineer to join a data team in the financial services arm of a global automotive company. You will build and optimize ETL pipelines in Azure and Databricks, migrate legacy data, ensure data quality and collaborate with cross-functional teams to deliver actionable insights.

The role requires 5+ years in data engineering, strong SQL and Python/Java/Scala skills, plus Azure Databricks expertise and relevant certifications.