Senior Data Engineer

Randstad Digital Italia; Bardi; In loco; EUR 60.000 - 85.000; Tempo pieno

Descrizione del lavoro

A global consulting company is seeking a Senior Data Engineer to join their Data Science and Analytics team in Italy. The ideal candidate has at least 8 years of experience in building big-data pipelines and strong skills in Spark and Databricks. This role involves designing data platforms, developing large-scale data systems, and ensuring high data quality. The position requires fluent English and offers opportunities for innovation in a dynamic environment.

Competenze

• At least 8 years of experience building big-data pipelines within modern IoT message-based cloud ecosystems.
• Familiarity with message queues, OLTP and OLAP databases, and Spark-based analytics platforms.
• Experience with agile software processes and a strong advocate for engineering best practices.

Mansioni

• Design, develop, test, monitor, and validate the Data Platform activity.
• Build large-scale batch and real-time data processing systems within IoT cloud platforms.
• Improve data quality through testing, tooling, and performance evaluation.

Conoscenze

Strong Spark skills

Fluent English

.NET, C#

Strumenti

Databricks

Azure

Descrizione del lavoro

Nice to meet you. We are Randstad Digital.

Randstad Digital is a global consulting company in the Information Technologies and Engineering sectors , with over 25,000 experts all over the world. We are an organization that puts talent first , and we are focused on enabling our clients in their digital transformation journeys and in developing major technology-driven projects .

Are you ready for your next challenge?

About the job

Our Data Science and Analytics team builds data solutions based on IoT data that we collect from hundreds of thousands of devices connected across the globe. We are hiring a senior data engineer who is passionate about building structured, high-quality data pipelines and can help us drive the development of our cloud analytics platform . These solutions will be used to evolve our products, and to give insights to our fleet of tens of thousands of technicians troubleshooting issues on the field. We process terabytes of data using tools such as Spark pipelines combined with various Azure cloud products such as different message queues, relational and non-relational OLTP and OLAP databases, etc. etc.

What you'll do

Design, develop, test, monitor, and validate the Data Platform activity.

Build large-scale batch and real-time data processing systems within IoT cloud platforms.

Evolve our data pipelines towards technical excellence by improving data quality through testing, tooling and continuously evaluating performance at scale.

Continuously improving our code base by working with innovative data processing frameworks, technologies, and platforms.

Facilitate and drive collaboration with other software engineers, data scientists, and cloud architects, to build exceptional data powered products.

Who you are

You are knowledgeable and curious about software engineering. You care deeply about agile software processes, reliability, and responsible experimentation as well as being a strong advocate for engineering best practices such as continuous integration and delivery.

As part of the R&D department, we are constantly evolving and innovating. We cannot predict which new technologies will emerge in the future, but we are excited to explore them. You are curious, proactive, and ready to help us discover and adopt cutting-edge solutions.

Must have

At least 8 years of experience building big-data pipelines within modern IoT message-based cloud ecosystems, at the intersection of message queues, OLTP and OLAP databases, and Spark-based analytics platforms.

Strong Spark skills

Databricks

Fluent English

Nice to have :

• .NET, C#

Azure

The search is open to candidates of both sexes (Law 903 / 77). Please read the privacy policy pursuant to Article 13 of Regulation (EU) 2016 / 679 on data protection (GDPR).