Real-Time Data Engineer: Cloud Pipelines & Analytics

JobCubby; Katowice; Hybrid; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work

Remote work up to 40 days/year

One-time hybrid allowance€250

Job summary

ComeOn Group is seeking a Data Engineer to design, build, and maintain robust batch and streaming data pipelines in a modern cloud environment. You will implement data quality best practices and ensure reliable data feeds for analytics and ML use across our datalake and regulatory reporting.

The ideal candidate has 3+ years in data integration and real-time streaming, experience with Spark, AWS or GCP, and proficiency in Python or Scala/Java.

Qualifications

• Three+ years in data integration and real-time streaming
• Experience with Spark or similar for large datasets
• Experience with AWS or GCP data processing
• Programming experience in Python or Scala/Java
• Excellent command of spoken English
• Strong attention to data quality and detail

Responsibilities

• Design, build, and maintain batch and streaming data pipelines in a modern cloud environment
• Apply data engineering best practices to ensure data quality and consistency
• Troubleshoot data feeds and maintain uninterrupted data flow
• Facilitate communication between business and technical teams on data strategy
• Own the development lifecycle and work independently when needed

Skills

Data integration

Real-time streaming

Spark

AWS

GCP

Python

Scala/Java

English

Education

Bachelor's degree in CS/SE/Math

Tools

Airflow

SQL

Data warehousing

Job description

ComeOn Group is seeking a Data Engineer to design, build, and maintain robust batch and streaming data pipelines in a modern cloud environment. You will implement data quality best practices and ensure reliable data feeds for analytics and ML use across our datalake and regulatory reporting.

The ideal candidate has 3+ years in data integration and real-time streaming, experience with Spark, AWS or GCP, and proficiency in Python or Scala/Java.