Databricks Data Engineer - 2+ months - Remote - Start ASAP

freelance.ca; Frankfurt; Remote; EUR 60.000 - 80.000; Vollzeit

Zusammenfassung

A leading freelance platform is seeking an experienced Databricks Data Engineer to support an international client on a proof of concept (POC). The role includes working on the design and implementation of Databricks, with strong expertise in structured streaming APIs required. The position is primarily remote but may require some onsite work in Germany. Fluency in English is essential, with German as a nice-to-have.

Qualifikationen

• Longterm project experience in implementing Databricks.
• Strong project experience as Engineer in Databricks.
• Proven experience in structured streaming API in both micro-batch and real-time modes.

Aufgaben

• Support client in POC for Databricks.
• Gather requirements and work on design phase of specific use cases.
• Create structured streaming API in both micro-batch and real-time modes.

Kenntnisse

Databricks

Structured streaming API

Python

SQL

Project management

Fluency in English

Jobbeschreibung

For our international client, we are looking for an experienced Databricks Data Engineer.

Your main task is to support the client in a POC (proof of concept) in the design and implementation of Databricks.

You need to have project experience in structured streaming API, in both micro-batch and real-time modes.

Tasks

• Support client in POC for Databricks
• Gather requirements
• Work on Design phase of specific used cases of Databricks
• Create structured streaming API, in both micro-batch and real-time modes
• Help with set up of Databricks
• Set up guidelines and standards for POC
• Implementation of POC for Databricks
• Best practice advise
• Regular communication between business, IT and vendor

Requirements

• Longterm project experience in implementing Databricks
• Strong project experience as Engineer
• Strong experience in design of Databricks
• Proven experience in structured streaming API, in both micro-batch and real-time modes - must have
• Project experience in setting up guidelines and standards in Databricks
• Experience with Python and SQL
• Project experience in international projects and design of global solutions
• Nice to have : Experience in supporting in POC projects
• Fluency in English, German nice to have but not a must

Project details

• Start : ASAP (October)
• Duration : 2.5 months (+ option to extend)
• Workload : 5 days per week
• Location : 100% Remote (CET Time zone), some on site work in Germany may be required for workshops
• Languages : Fluency in English, German nice to have but not a must

Telephone interview slots with our client can be arranged at short notice with a decision immediately thereafter.