Databricks Data Architect & Engineer for ML Pipelines

NTT DATA Europe & Latam; Cosenza; On-site; EUR 70,000 - 110,000; Full time

Job summary

NTT Data Europe & Latam seeks a Databricks Expert to bridge Data Science and Data Engineering, delivering data acquisition, transformations and loading into data lakes for analytics and ML.

You will work across cloud-native environments (GCP/AWS/Azure), build proofs-of-concept, and migrate workloads to the cloud while monitoring distributed infra using Grafana/Prometheus; strong Java/Scala/Python skills are required.

Qualifications

• 5+ years experience in cloud native environments with Databricks preferred.
• Experience with Big Data architectures, cloud and on premise.
• Azure infrastructure and networking experience.
• Proven ability to deliver proofs-of-concept to address business needs.
• Experience migrating workloads from on premise to cloud.
• Experience monitoring distributed infrastructure (Grafana/Prometheus).
• Proficiency in Java, Scala, Python, and shell scripting.
• SQL language knowledge.
• Experience leading medium teams.
• Experience with Spark, Databricks, Azure Data Factory, and Azure Synapse.
• Microsoft Certification on Azure or Databricks.

Responsibilities

• Support customers in Big Data projects working with analysts and solution architects to understand use cases and data needs.
• Deliver data acquisition, transformations, cleansing, conversion, and loading of data into data lakes for analytics and ML models.

Skills

Java

Scala

Python

Shell scripting

SQL

Team leadership

Apache Spark

Databricks

Azure Data Factory

Azure Synapse

ETL/ELT tools

Azure Certification

Cloud platforms

Tools

Grafana

Prometheus

PowerBI

Tableau

Qlik

Job description

NTT Data Europe & Latam seeks a Databricks Expert to bridge Data Science and Data Engineering, delivering data acquisition, transformations and loading into data lakes for analytics and ML.

You will work across cloud-native environments (GCP/AWS/Azure), build proofs-of-concept, and migrate workloads to the cloud while monitoring distributed infra using Grafana/Prometheus; strong Java/Scala/Python skills are required.