Data Engineer (Digital Marketing sphere)

COHERENT SOLUTIONS sp. z o.o.; Deutschland; Vor Ort; EUR 27.798 - 41.697; Vollzeit

Benefits dieser Stelle

Health insurance

Remote & Hybrid work options

Training & conferences

Mentorship program

Sports activities

Referral program

Work anniversary & extra vacation days

Zusammenfassung

COHERENT SOLUTIONS sp. z o.o. seeks a Data Engineer to join the Digital Marketing sphere, focusing on end-to-end data solutions and next-generation data platforms.

You will work with Spark, Scala, Kafka, and Kubernetes to design, build, and productionize high-scale data pipelines in a collaborative environment. The role requires 4+ years in software development, strong Spark and Scala (or Python/Java) experience, and familiarity with SQL/NoSQL databases.

Qualifikationen

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent experience.
• 4+ years of software development experience.
• 2+ years of experience with Apache Spark.
• 2+ years of experience with Scala and/or Python or Java.
• Experience with high-performance, large-scale, distributed data systems.
• Experience with SQL and NoSQL databases.
• Experience with Kubernetes.
• Experience with Git;Experience building and optimizing data pipelines, ETL processes, and streaming systems (e.g., Hadoop, Spark, Kafka) is a plus.
• Familiarity with tools such as GitLab, Grafana, InfluxDB, and Kibana is a plus.
• Strong communication skills and ability to work effectively in a team.
• English level: B1+ or higher.

Aufgaben

• Own end-to-end development, from design to production, with a focus on innovation and efficiency.
• Lead and mentor developers on complex projects impacting core business systems.
• Contribute to the design and development of next-generation data solutions.
• Implement high-scale big data solutions and contribute to platform infrastructure and architecture.
• Research and evaluate core technologies, integrations, and external APIs.
• Collaborate with cross-functional stakeholders, including Product, Engineering, and data providers.
• Participate in an off-hours pager duty rotation.

Kenntnisse

Spark

Scala

Python

Java

SQL

NoSQL

Kubernetes

Git

ETL

Streaming systems

Communications

Ausbildung

Bachelor's degree in Computer Science / Computer Engineering or equivalent

Tools

GitLab

Grafana

InfluxDB

Kibana

Jobbeschreibung

Data Engineer (Digital Marketing sphere)

Poland

Company Background

Our client is a global technology company transforming the way brands and agencies make marketing decisions. Its platform enables marketers to plan and activate cross-channel, programmatic media campaigns using real-time research, proprietary audience data, advanced analytics, and more than 150 integrated partners including Facebook, Instagram, Pinterest, Snapchat, and Twitter. The company operates across North America, Europe, the Middle East, Asia, and Australia.

Project Description

Data Management Platform is the core system that receives, processes and provides information to other external DMPs and real time platforms. The purpose of DMP is to store the connection between users/devices and their respective behavioral categories. Further this data is used by the other teams for the analytics and digital ad targeting. Team roadmap includes developing a new system based on the streaming architecture with a relevant tech stack.

Technologies

• Spark
• Scala
• Vertica
• Kafka
• Airflow
• K8S

What You'll Do

• Own end-to-end development, from design to production, with a focus on innovation and efficiency;
• Lead and mentor developers on complex projects impacting core business systems;
• Contribute to the design and development of next-generation data solutions;
• Implement high-scale big data solutions and contribute to platform infrastructure and architecture;
• Research and evaluate core technologies, integrations, and external APIs;
• Collaborate with cross-functional stakeholders, including Product, Engineering, and data providers;
• Participate in an off-hours pager duty rotation;

Job Requirements

• Bachelor's degree in Computer Science, Computer Engineering, or equivalent experience;
• 4+ years of software development experience;
• 2+ years of experience with Apache Spark;
• 2+ years of experience with Scala (preferred) and/or Python or Java;
• Experience working with high-performance, large-scale, or distributed data systems;
• Experience with SQL and NoSQL databases;
• Experience with Kubernetes;
• Experience with Git;Experience building and optimizing data pipelines, ETL processes, and streaming systems (e.g., Hadoop, Spark, Kafka) is a plus;
• Familiarity with tools such as GitLab, Grafana, InfluxDB, and Kibana is a plus;
• Strong communication skills and ability to work effectively in a team;
• English level: B1+ or higher;

What Do We Offer

The global benefits package includes:

• Technical and non-technical training for professional and personal growth;
• Internal conferences and meetups to learn from industry experts;
• Support and mentorship from an experienced employee to help you professional grow and development;
• Health insurance;
• Sports activities to promote a healthy lifestyle;
• Flexible work options, including remote and hybrid opportunities;
• Referral program for bringing in new talent;
• Work anniversary program and additional vacation days.