Senior Data Engineer

Sky Italia; Milano; In loco; EUR 60.000 - 80.000; Tempo pieno

Descrizione del lavoro

A technology-focused company in Milan is seeking a skilled Senior Data Engineer to develop and manage data pipelines that drive better experiences for users. The role necessitates strong expertise in Python and SQL, as well as at least 7 years of experience in data engineering. Candidates should be fluent in both Italian and English, with a passion for agile software processes and engineering best practices.

Competenze

• At least 7 years of experience in data engineering, business intelligence, and data science.
• Experience in building data pipelines for MPP databases.
• Fluent in Italian and English.

Mansioni

• Build large-scale data processing systems with Python and cloud platforms.
• Evolve data pipelines to improve quality through testing and performance evaluation.
• Perform root cause analysis on data and processes.
• Continuously improve the code base with innovative data processing frameworks.

Conoscenze

Python

SQL

Data Modeling

Apache Beam

Apache Spark

Cloud Solutions

Formazione

BSc in Maths or Computer Science

Strumenti

GCP (BigQuery)

Descrizione del lavoro

Our Data Engineering team builds highly intuitive data solutions that underpin business functions across Sales, Marketing, Finance and Operations. We are hiring senior data engineers who are passionate about building structured, high-quality data pipelines. These solutions will be used to evolve our products, bringing better experiences to Sky business users and to Sky subscribers. We process terabytes of data using tools such as Python, SQL and GCP products suite (BigQuery and a managed Airflow).

Responsibilities

• oBuild large-scale batch and real-time data processing systems with Python and cloud platforms. Facilitate and drive collaboration with other software engineers, data scientists, and decision-makers, such as product managers, to build exceptional data powered products.
• Evolving our data pipelines towards technical excellence by improving data quality through testing, tooling and continuously evaluating performance at scale.
• Perform root cause analysis on data and processes to answer business questions and find opportunities for improvement.
• Continuously improving our code base by working with innovative data processing frameworks, technologies, and platforms.
• Design, develop, test, monitor, manage and validate the Data Platform activity. Including the definition of the process for the change management of the continuous integration

Who you are

reYou are knowledgeable and driven about software engineering. We use languages such as Python, Java and SQL combined with various cloud solutions. Although you might not have a background in our field, bringing knowledge and experience from other fields is merited. You care deeply about agile software processes, reliability, and responsible experimentation as well as being a strong advocate for engineering best practices such as continuous integration and deliver

Must Have

• aveBSc in Maths or Computer Science or equivalent working experie
• nceAt least 7 years of experience, sitting at the intersection of data engineering, business intelligence and data scie
• nceYou understand what it takes to build a very efficient and effective data infrastructure in modern digital and tech compan
• iesExperience in Data Modeling and building data pipelines for MPP databa
• sesFluent in Italian and Engl

Nice to

• haveExperience working with high volume data, preferably with data processing frameworks like Apache Beam, Apache S
• parkStrong analytical skills and love to visualize your data findings in a clear and easy way to understand and to collect corner cases of implementat