Senior Data Engineer

Randstad Digital Italia; Lazio; In loco; EUR 60.000 - 80.000; Tempo pieno

Descrizione del lavoro

A technology solutions firm is looking for a Senior Data Engineer with at least 8 years of experience in building big-data pipelines within modern IoT cloud ecosystems. The role involves designing and developing data platforms, improving data quality, and collaborating with diverse teams. Strong skills in Spark and Databricks are essential, along with fluent English. This position is based in Italy, Lazio and offers a dynamic environment for technology lovers.

Competenze

• At least 8 years of experience in big-data pipelines.
• Experience with IoT message-based cloud ecosystems.
• Proficient in OLTP and OLAP databases.

Mansioni

• Design, develop, test, monitor, and validate the Data Platform.
• Build batch and real-time data processing systems.
• Improve data quality through testing and tools.
• Collaborate with engineers and data scientists.

Conoscenze

Data pipeline building

Strong Spark skills

Databricks

Fluent English

Strumenti

Azure

C#

Descrizione del lavoro

About the job

Our Data Science and Analytics team builds data solutions based on IoT data that we collect from hundreds of thousands of devices connected across the globe. We are hiring a senior data engineer who is passionate about building structured, high‑quality data pipelines and can help us drive the development of our cloud analytics platform.

• These solutions will be used to evolve our products, and to give insights to our fleet of tens of thousands of technicians troubleshooting issues on the field. We process terabytes of data using tools such as Spark pipelines combined with various Azure cloud products such as different message queues, relational and non‑relational OLTP and OLAP databases, etc.

What you’ll do

• Design, develop, test, monitor, and validate the Data Platform activity.
• Build large‑scale batch and real‑time data processing systems within IoT cloud platforms.
• Evolve our data pipelines towards technical excellence by improving data quality through testing, tooling and continuously evaluating performance at scale.
• Continuously improving our code base by working with innovative data processing frameworks, technologies, and platforms.
• Facilitate and drive collaboration with other software engineers, data scientists, and cloud architects, to build exceptional data‑powered products.

Who you are

You are knowledgeable and curious about software engineering. You care deeply about agile software processes, reliability, and responsible experimentation as well as being a strong advocate for engineering best practices such as continuous integration and delivery.

As part of the R&D department, we are constantly evolving and innovating. We cannot predict which new technologies will emerge in the future, but we are excited to explore them. You are curious, proactive, and ready to help us discover and adopt cutting‑edge solutions.

Must have

• At least 8 years of experience building big‑data pipelines within modern IoT message‑based cloud ecosystems, at the intersection of message queues, OLTP and OLAP databases, and Spark‑based analytics platforms.
• Strong Spark skills
• Databricks
• Fluent English

Nice to have

• .NET, C#

Azure

The search is open to candidates of both sexes (Law 903 / 77). Please read the privacy policy pursuant to Article 13 of Regulation (EU) 2016 / 679 on data protection (GDPR).