Databricks Expert - Data Engineer/Data Architect

TN Italy; Torino; In loco; EUR 40.000 - 80.000; Tempo pieno

Descrizione del lavoro

An established industry player is seeking a Databricks Expert to support customers in transformative Big Data projects. This role involves collaborating with business analysts and solution architects to address data needs, ensuring seamless data acquisition and transformation for analytics and machine learning. The ideal candidate will bridge the gap between Data Science and Data Engineering, bringing innovative solutions to cloud-native challenges. Join a culturally diverse team that values continuous improvement and a KAIZEN approach to skill enhancement, making a significant impact in the Data & Intelligence Service Line.

Competenze

• 5+ years experience with Databricks and cloud-native environments.
• Proven ability to build proofs-of-concept tailored to business needs.

Mansioni

• Support customers in Big Data projects and collaborate with analysts.
• Handle data acquisition, transformation, and loading into data lakes.

Conoscenze

Cloud-native environments

Databricks

Big Data architectures

Azure infrastructure

Java

Scala

Python

SQL

Apache Spark

Data Visualization tools

Strumenti

Azure Data Factory

Azure Synapse

Grafana

Prometheus

Talend

Oracle Data Integrator

Informatica PowerCenter

PowerBI

Qlik

Tableau

Descrizione del lavoro

Job Description

For more details, visit: www.nttdata.com/it

Responsibilities

Your role as a Databricks Expert at NTT Data involves supporting customers in Big Data projects by collaborating with business analysts and solution architects to understand use cases, data needs, and desired outcomes. You will handle data acquisition, transformation, cleansing, conversion, compression, and loading into data lakes for analytics and machine learning models.

The Databricks Expert should understand the challenges of a cloud-native environment and be able to develop innovative yet simple solutions to daily issues.

We seek an engineer or architect who can bridge Data Science and Data Engineering, possessing a clear understanding of both fields.

If you are a Data Scientist seeking more experience in data preparation, or a Data Engineer interested in Data Science, and willing to adopt a KAIZEN approach to continuously improve your skills, you may find a suitable role in NTT Data’s Data & Intelligence Service Line, within a culturally diverse environment blending Japanese and European influences.

Required Skills

• Experience in a cloud-native environment on at least one of the major public clouds (GCP, AWS, Azure); 5 years experience with Databricks preferred.
• Knowledge of Big Data architectures, both cloud and on-premise.
• Azure infrastructure and networking experience.
• Proven ability to build and deliver proofs-of-concept tailored to specific business needs using appropriate techniques, data sources, and technologies.
• Experience migrating workloads from on-premise to cloud environments.
• Monitoring distributed infrastructure using Azure tools or open-source solutions like Grafana or Prometheus.
• Proficiency in Java, Scala, Python, and shell scripting.
• Knowledge of SQL language.
• Experience leading medium-sized teams.
• Hands-on experience with Apache Spark, Databricks, Azure Data Factory, Azure Synapse, and other Azure ETL/ELT tools.
• Microsoft certification(s) related to Azure or Databricks (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Spark Developer, Data Engineer, or Machine Learning).

Desired Skills and Certifications

• Experience with Agile methodologies and Kanban.
• Additional Big Data certifications (Cloudera, Databricks, etc.) are advantageous.
• Experience with non-Azure ETL/ELT tools such as Talend, Oracle Data Integrator, Informatica PowerCenter.
• Experience with Data Visualization tools like PowerBI, Qlik, Tableau.

Locations

Milano, Bari, Bologna, Cosenza, Napoli, Roma, Salerno, Torino, Treviso, Pisa