Databricks Expert - Data Engineer/Data Architect

NTT DATA

Information Technology

Specialista Senior / Project Manager

www.nttdata.com/it

Responsibilities

Your role as a Databricks Expert in NTT Data will include supporting customers in Big Data projects, working in partnership with business analysts and solution architects to understand use cases, data needs, and outcome objectives. You will deliver data acquisition, transformations, and improvement, cleansing, conversion, compression, and loading of data into data lakes for analytics and machine learning models.

The Databricks Expert in NTT Data understands the challenges of a cloud-native environment and can think outside the box to find innovative yet simple solutions to everyday issues.

We seek an engineer/architect who can bridge Data Science and Data Engineering, with a clear understanding of both domains.

If you are a Data Scientist looking to gain more experience in data preparation, or a Data Engineer interested in Data Science, with a KAIZEN approach to continuous improvement of skills and knowledge, you can join NTT Data’s Data & Intelligence Service Line as a Databricks Expert, in an environment blending Japanese and European cultural elements.

Requirements

Required Skills

• Experience in a cloud-native environment with at least one of the three major public clouds (GCP, AWS, Azure); 5+ years experience with Databricks preferred
• Knowledge of Big Data Architectures, both cloud and on-premise
• Azure infrastructure and networking experience
• Proven ability to build and deliver proofs-of-concept to address specific business needs using appropriate techniques, data sources, and technologies
• Experience migrating workloads from on-premise to cloud environments
• Monitoring distributed infrastructure using Azure tools or open-source tools like Grafana or Prometheus
• Proficiency in Java, Scala, Python, and shell scripting
• Experience leading medium-sized teams
• Hands-on experience with Apache Spark, Databricks, Azure Data Factory, Azure Synapse, and other Azure ETL/ELT tools
• Microsoft certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, Databricks Spark Developer, Databricks Data Engineer, or Databricks Machine Learning

Desired skills, experiences, and certifications include:

• Experience with Agile methodologies and Kanban
• Additional Big Data certifications (Cloudera, Databricks, etc.)
• Experience with non-Azure ETL/ELT solutions (Talend, Oracle Data Integrator, Informatica PowerCenter, etc.)
• Experience with Data Visualization tools (PowerBI, Qlik, Tableau, etc.)