Data Engineer

TN Germany; Berlin; Hybrid; EUR 55.000 - 85.000; Vollzeit

Zusammenfassung

An established industry player is seeking a talented Data Engineer to join their dynamic team in Berlin. In this role, you will develop and implement scalable data pipelines, ensuring high-quality code and contributing to a collaborative work culture. The ideal candidate will have profound experience in object-oriented design, cloud platforms, and big data frameworks like Spark. If you're passionate about data engineering and want to make an impact in a rapidly evolving industry, this opportunity is perfect for you.

Qualifikationen

• 3+ years of experience writing code in Scala and Python.
• Proven experience with Spark data processing and data modeling techniques.

Aufgaben

• Develop and implement data pipelines for strategic goals.
• Write maintainable code and conduct code reviews.

Kenntnisse

Object-oriented design

Design patterns

Microservices architecture

Data structures

Algorithms

Cloud platforms

MySQL

Big data aggregation frameworks (Spark)

Kafka

RabbitMQ

Agile environment

C++

English communication

Tools

Scala

Python

Spark

Airflow

Jobbeschreibung

Social network you want to login/join with:

Data Engineer

Berlin, Germany
EMEA – AGP Tech / Full-time / Hybrid

At Digital Turbine, we make mobile advertising experiences more meaningful and rewarding for users, app publishers, and advertisers — intelligently connecting people in more ways, across more devices. We provide app publishers and advertisers with powerful ads and experiences that captivate consumers, fuel performance, and help telecoms and OEMs supercharge awareness, acquisition, and monetization. In a rapidly evolving industry, we are constantly innovating and creating better paths of discovery to connect consumers, publishers, and advertisers across the mobile ecosystem. We're looking for a Data Engineer to join our amazing and dynamic team.

Responsibilities of the Data Engineer role:

1. Create highly scalable and fault-tolerant technical designs working with team members (up to 5 people)
2. Develop and implement data pipelines that extract, transform, and load data into an information product that helps to inform the organization in reaching strategic goals
3. Write high-quality code, conduct and participate in code reviews, and follow strong engineering principles and standards
4. Research the technical feasibility of new ideas and actively suggest technology improvements
5. Quickly develop a thorough understanding of the product, architecting the system and shipping production-ready code
6. Write maintainable code that can scale fast
7. Support and contribute to our amazing work culture

Qualifications of the Data Engineer role:

General:

• Profound experience & understanding of object-oriented design, design patterns, microservices architecture, data structures, algorithms and their complexities, systems architecture
• Skilled in writing and automating tests for your code
• Proven working experience with cloud platforms
• Working experience with OLTP databases, specifically MySQL, understands challenges related to query execution and optimization (indexing, cascading)
• Working experience with big data aggregation frameworks (Spark)
• Experience with streaming platforms like Kafka and RabbitMQ
• Experience working in an agile environment
• Experience with C++ or any front-end framework is a plus
• Excellent verbal and written communication skills in English

Big Data related:

• 3+ years of experience with writing code in Scala
• Experience with Python, Spark, Airflow
• Experience with Scala testing frameworks
• Understanding of data warehousing and data-modeling techniques
• Proven experience with writing code for Spark data processing
• Familiarity with various OLAP data stores (Druid, ClickHouse, etc.) and their insights
• Experience with at least one columnar OLAP database
• Familiarity with industry-standard analytics and visualization tools