Databricks Expert - Data Engineer/Data Architect

TN Italy; Milano; In loco; EUR 50.000 - 90.000; Tempo pieno

Descrizione del lavoro

Join a forward-thinking company as a Databricks Expert, where you'll play a pivotal role in supporting customers with their Big Data projects. This position offers the chance to bridge the gap between Data Science and Data Engineering, working in a culturally rich environment that blends innovative approaches with continuous skill improvement. You'll be responsible for data acquisition and transformation, leveraging your expertise in cloud-native solutions and Databricks. If you're passionate about data and eager to make a significant impact, this opportunity is perfect for you.

Competenze

• 5+ years of experience in Databricks and cloud-native environments.
• Proficiency in Java, Scala, Python, and SQL for data processing.

Mansioni

• Support customers in Big Data projects and handle data transformation.
• Collaborate with analysts and architects to meet data needs.

Conoscenze

Cloud-native environment experience

Databricks

Big Data architectures

Azure infrastructure and networking

Java

Scala

Python

SQL

Apache Spark

ETL/ELT tools

Formazione

Microsoft certifications (Azure Data Engineer Associate, etc.)

Strumenti

Azure Data Factory

Azure Synapse

Grafana

Prometheus

Talend

Oracle Data Integrator

Informatica PowerCenter

PowerBI

Qlik

Tableau

Descrizione del lavoro

Job Description

Visit www.nttdata.com/it for more information.

Responsibilities

Your role as a Databricks Expert at NTT Data involves supporting customers in Big Data projects, collaborating with business analysts and solution architects to understand use cases, data needs, and outcome objectives. You will handle data acquisition, transformation, cleansing, conversion, compression, and loading into data lakes for analytics and machine learning models.

The Databricks Expert understands the challenges of a cloud-native environment and devises innovative yet simple solutions to daily issues.

We seek an engineer/architect who bridges Data Science and Data Engineering, with a clear grasp of both fields.

If you are a Data Scientist seeking more data preparation experience, or a Data Engineer interested in Data Science, and embrace a KAIZEN approach to continuous skill improvement, you can join NTT Data’s Data & Intelligence Service Line, in a culturally rich environment blending Japanese and European elements.

Required Skills

• Experience in a cloud-native environment on at least one major public cloud (GCP, AWS, Azure); 5+ years experience with Databricks preferred.
• Knowledge of Big Data architectures, both cloud and on-premise.
• Experience with Azure infrastructure and networking.
• Proven ability to build and deliver proofs-of-concept addressing specific business needs using appropriate techniques and technologies.
• Experience migrating workloads from on-premise to cloud.
• Monitoring distributed infrastructure using Azure tools or open-source solutions like Grafana or Prometheus.
• Proficiency in Java, Scala, Python, and shell scripting.
• Knowledge of SQL.
• Experience leading medium-sized teams.
• Hands-on experience with Apache Spark, Databricks, Azure Data Factory, Azure Synapse, and related ETL/ELT tools.
• Microsoft certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Spark Developer, Data Engineer, or Machine Learning certifications.

Desired Skills and Certifications

• Experience with Agile methodologies like Kanban.
• Additional certifications such as Cloudera or Databricks are advantageous.
• Experience with non-Azure ETL/ELT tools like Talend, Oracle Data Integrator, Informatica PowerCenter.
• Knowledge of Data Visualization tools such as PowerBI, Qlik, Tableau.

Location

Milano, Bari, Bologna, Cosenza, Napoli, Roma, Salerno, Torino, Treviso, Pisa