Hybrid Data Factory Engineer: Pipelines & Lakehouse

MSC Cruises; Napoli; Hybrid; EUR 38,000 - 45,000; Full time

Benefits offered by this job

Health Insurance

Learning opportunities

Flexible working hours

Employee Assistance Programme

Discounts & Partnerships within theMSC

Job summary

MSC Cruises is seeking a Data Engineer to design and operate backend data pipelines across on-premises and cloud environments, evolving toward Microsoft Fabric and Databricks. You will implement modern Lakehouse patterns, ensure data quality, and collaborate with Data Architects and engineers.

The role requires 5–7 years in data engineering, strong SQL and Python/PySpark skills, and experience with on-prem and cloud integrations.

Qualifications

• Bachelor's or Master’s in Computer Science, Engineering, Information Systems, or related discipline.
• 5–7 years of professional Data Engineering/ETL experience in complex environments.
• Strong SQL skills, data analysis, and data modeling.
• Hands-on Python and PySpark; Java/Scala a plus.
• Experience with on-prem and cloud data integration (Oracle/SQL Server, SSIS, schedulers).
• Knowledge of Microsoft Fabric and Databricks, Spark, Delta Lake, and Notebooks.

Responsibilities

• Design, build, test, deploy, and maintain backend data pipelines for ingestion, transformation, orchestration, and delivery across on-premises and cloud environments.
• Develop and enhance ETL/ELT solutions for the current on-premises Data Platform.
• Contribute to the Data Platform based on Microsoft Fabric and Databricks.
• Apply data engineering patterns including metadata-driven pipelines and idempotency.
• Translate data designs into robust backend implementations with cross-functional teams.
• Implement automated data quality checks, logging, and operational monitoring.
• Optimize pipelines for performance, scalability, and cost.
• Manage source code with Git-based workflows and CI/CD pipelines.

Skills

SQL skills

Python

PySpark

Git & CI/CD

DataOps

Agile teamwork

English fluency

Education

Bachelor's or Master’s in CS/Engineering

Tools

Spark

Delta Lake

Databricks

OneLake

Fabric Data Factory

Azure Data Factory

SQL Server / Oracle

Job description

MSC Cruises is seeking a Data Engineer to design and operate backend data pipelines across on-premises and cloud environments, evolving toward Microsoft Fabric and Databricks. You will implement modern Lakehouse patterns, ensure data quality, and collaborate with Data Architects and engineers.

The role requires 5–7 years in data engineering, strong SQL and Python/PySpark skills, and experience with on-prem and cloud integrations.