Databricks Expert - Data Engineer/Data Architect

Ntt Data; Latina; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

NTT DATA, Inc. seeks a Databricks expert to bridge Data Science and Data Engineering for cloud-native data solutions. You will support customers on Big Data initiatives, collaborating with analysts and solution architects to align use cases with data needs and outcomes.

You will build and optimize data pipelines for analytics and ML, enabling governed data lakes, and contribute to PoCs and migrations from on-prem to cloud environments. This role is hybrid and involves leading mid-sized teams.

Qualifications

• 5+ years of experience with Databricks and cloud-based data engineering
• Strong programming skills in Python, Java, and Scala
• Experience delivering data pipelines for analytics and ML on cloud platforms
• Hands-on with Spark, Databricks, Azure Data Factory, and Azure Synapse
• Proven ability to lead medium-sized teams and mentor others
• Knowledge of cloud infrastructures (Azure, AWS, or GCP) and data lake governance
• Microsoft Azure certification or Databricks certification is a plus

Responsibilities

• Bridge Data Science and Data Engineering to craft cloud-native data solutions
• Support customers on Big Data projects and collaborate with analysts and solution architects
• Deliver data acquisition, transformations, cleansing, loading into data lakes for analytics/ML
• Assist in designing data pipelines to support analytics and machine learning
• Contribute to PoCs and migration efforts from on-premise to cloud environments
• Monitor and optimize distributed infrastructure using Azure tools or Grafana/Prometheus

Skills

Databricks

Spark

Python

Java

Scala

Shell scripting

Azure

AWS

GCP

Data Factory

Synapse

Kubernetes

Grafana

Prometheus

Leadership

Tools

Databricks

Azure Data Factory

Azure Synapse

Grafana

Prometheus

Job description

As a Databricks Expert at NTT DATA, you will bridge Data Science and Data Engineering to craft cloud-native data solutions. You’ll support customers on Big Data initiatives, collaborating with analysts and solution architects to align use cases with data needs and outcomes. You’ll build and optimize data pipelines, enabling analytics and machine learning through well-governed data lakes. This hybrid role places you in a cross-cultural environment, fostering continuous skill growth and impactful data-driven transformation.

• Support customers on Big Data projects and collaborate with business analysts and solution architects to understand use cases and outcomes
• Deliver data acquisition, transformations, cleansing, conversion, compression and loading into data lakes for analytics/ML consumption
• Assist in designing data pipelines and enhancements to support analytics and machine learning
• Contribute to PoCs and migration efforts from on-premise to cloud environments
• Monitor and optimize distributed infrastructure using Azure or open-source tooling
• Cloud-native experience in at least one of GCP, AWS, or Azure
• 5+ years experience with Databricks (preferred)
• Knowledge of Big Data architectures (cloud and on-premises)
• Azure infrastructure and networking experience
• Experience delivering PoCs addressing business needs with appropriate tech
• Experience migrating workloads from on-prem to cloud
• Experience monitoring distributed infrastructure (Azure tools or Grafana/Prometheus)
• Proven programming skills in Java, Scala, Python, and shell scripting
• Experience leading medium-sized teams
• Hands-on with Spark, Databricks, Azure Data Factory, and Azure Synapse
• Microsoft Certifications relevant to Azure or Databricks
• Leadership and mentoring of teams
• Strong collaboration and cross-functional communication
• Problem-solving mindset with Kaizen approach
• Databricks