Senior Data Engineer...

Randstad Digital Italia; Milano; In loco; EUR 60.000 - 80.000; Tempo pieno

Descrizione del lavoro

A global consulting company is seeking a senior data engineer in Milan. The ideal candidate will have at least 8 years of experience in building big-data pipelines, strong Spark skills, and a proactive approach to software engineering. This role offers the opportunity to design and develop data solutions in an innovative environment focused on cloud analytics platforms.

Competenze

• At least 8 years of experience in big-data pipelines within IoT cloud ecosystems.
• Expertise at managing OLTP and OLAP databases.
• Strong understanding of Spark-based analytics platforms.

Mansioni

• Design, develop, test, monitor, and validate Data Platform activities.
• Build large-scale batch and real-time data processing systems.
• Improve data quality through testing and tooling.

Conoscenze

Experience building big-data pipelines

Strong Spark skills

Fluent English

Strumenti

Databricks

Azure

Descrizione del lavoro

Nice to meet you. We are Randstad Digital.

Randstad Digital is a global consulting company in the Information Technologies and Engineering sectors , with over 25,000 experts all over the world. We are an organization that puts talent first , and we are focused on enabling our clients in their digital transformation journeys and in developing major technology-driven projects .

Are you ready for your next challenge?

About the job

Our Data Science and Analytics team builds data solutions based on IoT data that we collect from hundreds of thousands of devices connected across the globe. We are hiring a senior data engineer who is passionate about building structured, high-quality data pipelines and can help us drive the development of our cloud analytics platform . These solutions will be used to evolve our products, and to give insights to our fleet of tens of thousands of technicians troubleshooting issues on the field. We process terabytes of data using tools such as Spark pipelines combined with various Azure cloud products such as different message queues, relational and non-relational OLTP and OLAP databases, etc. etc.

What you’ll do

• Design, develop, test, monitor, and validate the Data Platform activity.
• Build large-scale batch and real-time data processing systems within IoT cloud platforms.
• Evolve our data pipelines towards technical excellence by improving data quality through testing, tooling and continuously evaluating performance at scale.
• Continuously improving our code base by working with innovative data processing frameworks, technologies, and platforms.
• Facilitate and drive collaboration with other software engineers, data scientists, and cloud architects, to build exceptional data powered products.

Who you are

You are knowledgeable and curious about software engineering. You care deeply about agile software processes, reliability, and responsible experimentation as well as being a strong advocate for engineering best practices such as continuous integration and delivery.

As part of the R&D department, we are constantly evolving and innovating. We cannot predict which new technologies will emerge in the future, but we are excited to explore them. You are curious, proactive, and ready to help us discover and adopt cutting-edge solutions.

Must have :

• At least 8 years of experience building big-data pipelines within modern IoT message-based cloud ecosystems, at the intersection of message queues, OLTP and OLAP databases, and Spark-based analytics platforms.
• Strong Spark skills
• Databricks
• Fluent English

Nice to have :

• .NET, C#
• Azure

The search is open to candidates of both sexes (Law 903 / 77). Please read the privacy policy pursuant to Article 13 of Regulation (EU) 2016 / 679 on data protection (GDPR).