Data Engineer

Klar; Berlin; Vor Ort; EUR 50.000 - 70.000; Vollzeit

Zusammenfassung

An innovative technology company based in Berlin is seeking a Data Engineer to optimize and redesign their Digital Platform. The role involves expanding data pipeline architecture, supporting teams with data delivery, and working on data extraction and transformation using ETL/API. Candidates should have a Bachelor’s degree and possess skills in AWS, SQL/NoSQL, Python, and Apache Spark. Strong communication, teamwork, and problem-solving skills are essential for this position.

Qualifikationen

• Proficient in English required for communication.
• Experience with AWS for cloud-based solutions.
• Strong skills in SQL and NoSQL databases.
• Experience programming in Python for data manipulation.
• Knowledge of Apache Spark for big data processing.

Aufgaben

• Maintain optimal data pipeline architecture.
• Assemble complex datasets from diverse sources.
• Work on data extraction, transformation, and integration.
• Support experiments and debugging of algorithms.
• Build workflows for deploying algorithms at scale.

Kenntnisse

Proficient English language

Experience in AWS environment

Proficiency in SQL/NoSQL

Experience in Python

Proficiency Apache Spark

Ausbildung

Bachelor’s degree

Jobbeschreibung

Job Purpose

Klar's Data Engineer will be responsible to optimize and re-designing our Digital Platform and to support a new generation of data-driven services and initiatives. He/She will be responsible for expanding and optimizing our data pipeline architecture, supporting Data Engineers Data Scientists, Data Analysts and Software Engineers with optimal data delivery architectures and services.

Tasks and Responsibilities

• Support creation, maintenance and evolution of an optimal data pipeline architecture.
• Meet data team requirements, assembling large and complex datasets with a wide variety of data source
• Work on data extraction, enrichment, transformation and integration through ETL/API.
• Support experiments, development and debugging of algorithms.
• Build robust workflows for training, evaluation and deploying algorithms at scale.

Education Requirements

Bachelor’s degree

Required Hard Skills

• Proficient English language
• Experience in AWS environment
• Proficiency in SQL/NoSQL
• Experience in Python
• Proficiency Apache Spark

Required Soft Skills

• Curiosity
• Challenges acceptor
• Strong communication skills
• Teamwork
• Problem-solving
• Time management