Senior Data Engineer - Azure

Harnham; Amsterdam; On-site; EUR 90,000 - 130,000; Full time

Job summary

Harnham in Amsterdam seeks a Senior Data Engineer to architect and maintain scalable data systems, enabling data-driven logistics for clients worldwide.

Role requires lead experience, strong Python/Java/Scala, Spark/Hadoop, and cloud platforms. You will build robust data models and collaborate with cross-functional teams to optimize data infrastructure.

Join a fast-paced, technology-driven environment and help drive data excellence across the organization.

Qualifications

• Bachelor's degree in computer science, engineering or related field; advanced degree preferred.
• Proven experience leading data engineering initiatives and teams.
• Proficient in Python, Java or Scala and data processing frameworks like Spark/Hadoop.
• Strong SQL and NoSQL DB design and data modeling skills.
• Experience with cloud platforms (AWS, Azure, GCP) and Databricks.

Responsibilities

• Architect, develop, and maintain scalable data pipelines for large volumes of structured and unstructured data.
• Collaborate with cross-functional teams to translate data requirements into engineering solutions.
• Work extensively with Azure Databricks and related tooling.
• Develop and maintain data models; ensure data quality and integrity.
• Monitor and optimize data workflows for performance and scalability.
• Stay current with industry trends and propose innovative data infra solutions.

Skills

Lead Data Engineer

Python

Java

Scala

Spark

Hadoop

SQL

NoSQL

Data Modeling

Cloud Platforms

Leadership

Education

Bachelor's degree in CS/Engineering

Advanced degree preferred

Tools

Azure Databricks

Apache Spark

Hadoop

SQL Databases

NoSQL Databases

Job description

This company is a renowned home appliances retailer that is at the forefront of innovation and technology-driven solutions.

They are currently seeking a highly skilled and motivated Senior Data Engineer to join our dynamic team. As a crucial member of the organization, the Senior Data Engineer will play a pivotal role in shaping and optimizing our data infrastructure, enabling us to deliver exceptional logistics solutions to our clients worldwide.

This organization are dedicated to revolutionizing the logistics industry through cutting-edge technologies and data-driven insights. The mission is to provide seamless, efficient, and sustainable supply chain solutions to our customers, empowering them to thrive in the global marketplace.

THE ROLE:

You will be responsible for architecting, developing, and maintaining data systems, ensuring smooth data integration, transformation, and storage. This position requires a keen eye for detail and an in-depth knowledge of data engineering best practices. By leveraging your expertise, you will contribute to the success of the data-driven decision-making process and analytics initiatives.

Key Responsibilities:

• Design and implement scalable data pipelines for collecting, processing, and storing large volumes of structured and unstructured data.
• Collaborate with cross-functional teams to understand data requirements and translate them into efficient data engineering solutions.
• Work extensively with azure databricks
• Develop and maintain data models, ensuring data quality, integrity, and consistency throughout the organization.
• Continuously monitor and optimize data pipelines, identifying opportunities to improve efficiency, scalability, and performance.
• Stay up-to-date with industry trends and emerging technologies, proactively recommending innovative solutions to enhance our data infrastructure.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field; advanced degree preferred.
• Proven experience as a Lead Data Engineer or a similar role, demonstrating expertise in designing and implementing data engineering solutions.
• Proficient in programming languages such as Python, Java, or Scala, with experience in data processing frameworks (e.g., Apache Spark, Hadoop).
• Strong understanding of database systems, both SQL and NoSQL, and proficiency in data modeling and schema design.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and familiarity with data technologies in a cloud environment.
• Excellent problem-solving and analytical skills, with the ability to translate complex requirements into efficient data engineering solutions.
• Strong communication and leadership skills, with the ability to collaborate effectively with cross-functional teams.

Join the talented team and make a significant impact on data-driven logistics solutions. If you are passionate about data engineering, possess exceptional technical skills, and thrive in a fast-paced environment, we would love to hear from you.