Hybrid Data Engineer — Azure, Spark & Impact

Mercedes-Benz.io; Lisboa; Hybrid; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Health insurance

Life insurance

Open source software

Job summary

Mercedes-Benz.io, a part of the Mercedes-Benz Digital ecosystem, seeks a Data Engineer to build scalable data pipelines and maintain data foundations powering analytics and ML workflows. You will work with Azure Databricks, Data Factory, and Data Lake Storage to deliver reliable data solutions and partner with analysts and stakeholders across the business.

The role emphasizes collaboration, best practices in data management, and continuous improvement in platform performance within a flexible

Qualifications

• 3 to 5 years of hands-on software engineering experience building, maintaining, and optimizing data pipelines.
• Proficiency in Python and SQL for data processing and automation.
• Experience with Azure cloud services including Databricks, Data Factory, and Data Lake Storage.
• Strong understanding of Spark internals and PySpark.
• Knowledge of dimensional data modeling and data warehousing concepts.
• Excellent communication and collaboration with stakeholders.

Responsibilities

• Design and build scalable data pipelines for cleaning, integrating, and transforming large datasets.
• Create data processing infrastructure ensuring high-quality data for analysts and data scientists.
• Leverage Azure services to develop robust data solutions.
• Develop dimensional models and maintain data warehouses to support analytics.
• Write efficient Python and SQL code for large-scale data processing.
• Work with Spark to optimize PySpark code and queries.
• Collaborate with analysts to translate business needs into data solutions.
• Ensure data governance and data quality across platforms.
• Support deployment and monitoring of ML pipelines in production.
• Improve platform performance and reliability through automation.

Skills

PySpark

SQL

Python

OOP

CI/CD

Data modeling

Tools

Azure Databricks

Data Factory

Azure DevOps

Data Lake Storage

Kubernetes

Docker

Job description

Mercedes-Benz.io, a part of the Mercedes-Benz Digital ecosystem, seeks a Data Engineer to build scalable data pipelines and maintain data foundations powering analytics and ML workflows. You will work with Azure Databricks, Data Factory, and Data Lake Storage to deliver reliable data solutions and partner with analysts and stakeholders across the business.

The role emphasizes collaboration, best practices in data management, and continuous improvement in platform performance within a flexible