Senior Data Engineer - Real-Time ML Pipelines (Hybrid)

Comeon-Group; Katowice; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid work model

Company bonus scheme

Private health insurance

Job summary

ComeOn Group is seeking a Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving.

The role requires 5+ years in data integration, Python/SQL proficiency, and experience with Spark or Flink, as well as cloud data tools (GCP/AWS).

Qualifications

• 5+ years in data integration & real-time streaming.
• Proficient in Python and SQL; Java is a plus.
• Understanding data warehousing concepts and schema design.
• Experience with distributed frameworks like Spark or Flink.
• Experience with cloud data processing (GCP/AWS).
• English fluency and strong data quality focus.

Responsibilities

• Collaborate with Data Scientists to design and maintain robust batch and streaming pipelines.
• Ensure data quality, lineage, and reliability for production ML data.
• Troubleshoot data feeds and ensure uninterrupted data flow.
• Communicate with stakeholders about ML data requirements and delivery.
• Own the data science data development lifecycle from ingestion to serving.

Skills

Python

SQL

Java

Streaming

Data pipelines

Education

Bachelor's degree in CS or Math

Tools

GCP

AWS

BigQuery

Pub/Sub

Dataflow

Datastream

Spark

Flink

Job description

ComeOn Group is seeking a Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving.

The role requires 5+ years in data integration, Python/SQL proficiency, and experience with Spark or Flink, as well as cloud data tools (GCP/AWS).