Databricks Data Engineer - 2+ months - Remote - Start ASAP

RED SAP Solutions; Frankfurt; Remote; EUR 70.000 - 90.000; Vollzeit

Zusammenfassung

An international tech consulting firm is seeking an experienced Databricks Data Engineer to support clients in proof-of-concept projects. Responsibilities include designing and implementing Databricks solutions, and creating structured streaming APIs. Strong experience in Databricks and English fluency are essential. The role is primarily remote with some on-site work in Germany required for workshops.

Qualifikationen

• Longterm project experience in implementing Databricks.
• Strong project experience as Engineer.
• Proven experience in structured streaming API, in both micro-batch and real-time modes.

Aufgaben

• Support client in POC for Databricks.
• Work on design phase of specific use cases of Databricks.
• Create structured streaming API in both micro-batch and real-time modes.

Kenntnisse

Databricks experience

Structured streaming API

Python

SQL

Project experience in international projects

Jobbeschreibung

Overview

For our international client, we are looking for an experienced Databricks Data Engineer.

Your main task is to support the client in a POC (proof of concept) in the design and implementation of Databricks.

You need to have project experience in structured streaming API, in both micro-batch and real-time modes.

Tasks

• Support client in POC for Databricks
• Gather requirements
• Work on Design phase of specific used cases of Databricks
• Create structured streaming API, in both micro-batch and real-time modes
• Help with set up of Databricks
• Set up guidelines and standards for POC
• Implementation of POC for Databricks
• Best practice advise
• Regular communication between business, IT and vendor

Requirements

• Longterm project experience in implementing Databricks
• Strong project experience as Engineer
• Strong experience in design of Databricks
• Proven experience in structured streaming API, in both micro-batch and real-time modes - must have
• Project experience in setting up guidelines and standards in Databricks
• Experience with Python and SQL
• Project experience in international projects and design of global solutions
• Nice to have : Experience in supporting in POC projects
• Fluency in English, German nice to have but not a must

Project details

• Start : ASAP (October)
• Duration : months (+ option to extend)
• Workload : 5 days per week
• Location : 100% Remote (CET Time zone), some on site work in Germany may be required for workshops
• Languages : Fluency in English, German nice to have but not a must

Telephone interview slots with our client can be arranged at short notice with a decision immediately thereafter.