Senior Data Engineer (Remote) — Databricks on Azure

Shimi Sp. z o.o.; Województwo mazowieckie; Remote; PLN 165.000 - 235.000; Vollzeit

Benefits dieser Stelle

100% Remote

B2B via Shimi

Zusammenfassung

Shimi Sp. z o.o. in Poland seeks a Senior Data Engineer to design and deliver scalable data solutions on Azure Databricks and data lakehouse platforms for a global travel and cruise client.

You will build and optimize ETL/ELT processes, work with Python, SQL, Spark, and collaborate with cross-functional teams to enable analytics and reporting. The role requires 5+ years of Databricks experience, English level B2+, and a 100% remote, long-term engagement via B2B with Shimi.

Qualifikationen

• Minimum 5 years of commercial Databricks experience.
• Proficient in Spark, Python, SQL.
• Strong English, B2+ level.
• Ability to work independently with ownership.
• Experience with Azure Data Platform.

Aufgaben

• Design, develop, and maintain scalable data solutions within the Azure Data Platform ecosystem, including Azure Synapse, Databricks, and Data Lakehouse environments.
• Implement and optimize ETL/ELT processes for ingesting, transforming, and serving data from multiple business domains.
• Develop and maintain data processing solutions using Python, SQL, and Apache Spark.
• Support migration and modernization initiatives, including Unity Catalog adoption, platform upgrades, and data platform transformations.
• Build and maintain Databricks workflows, Delta Live Tables (DLT), metadata-driven frameworks, and orchestration processes.
• Collaborate with architects, analysts, and business stakeholders to translate business requirements into technical solutions.
• Ensure data quality, reliability, performance, and security across the data platform.
• Troubleshoot production incidents, perform root cause analysis, and implement corrective actions.
• Contribute to CI/CD implementation, infrastructure automation, monitoring, and operational best practices.
• Optimize data pipelines, storage structures, and processing workloads to improve efficiency and reduce costs.
• Participate in solution and architecture reviews while promoting engineering standards and governance principles.
• Support knowledge sharing, mentoring, and technical development within the team.
• Work closely with Data Architects and platform teams to ensure alignment with enterprise data architecture, Lakehouse principles, and governance requirements.
• Support reporting, analytics, and AI/ML initiatives by providing reliable and scalable data foundations.

Kenntnisse

Databricks

Azure Databricks

Apache Spark

Python

SQL

Azure Cloud

Data engineering

CI/CD

Delta Live Tables

Unity Catalog

Data governance

Data Lakehouse

Power BI

Stakeholder management

Tools

Azure Synapse Analytics

Azure Data Factory

Azure Data Lake

Azure DevOps

Jobbeschreibung

Shimi Sp. z o.o. in Poland seeks a Senior Data Engineer to design and deliver scalable data solutions on Azure Databricks and data lakehouse platforms for a global travel and cruise client.

You will build and optimize ETL/ELT processes, work with Python, SQL, Spark, and collaborate with cross-functional teams to enable analytics and reporting. The role requires 5+ years of Databricks experience, English level B2+, and a 100% remote, long-term engagement via B2B with Shimi.