Senior Data Engineer

Comeon-Group; Katowice; Hybrid; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid work model

Company bonus scheme

Private health insurance

Job summary

ComeOn Group is seeking a Data Engineer to design, build, and maintain near real-time and batch data flows powering production ML models. You will work with Data Scientists to create scalable pipelines in a hybrid work environment and help ensure data quality for model training and serving.

The role requires 5+ years in data integration, Python/SQL proficiency, and experience with Spark or Flink, as well as cloud data tools (GCP/AWS).

Qualifications

• 5+ years in data integration & real-time streaming.
• Proficient in Python and SQL; Java is a plus.
• Understanding data warehousing concepts and schema design.
• Experience with distributed frameworks like Spark or Flink.
• Experience with cloud data processing (GCP/AWS).
• English fluency and strong data quality focus.

Responsibilities

• Collaborate with Data Scientists to design and maintain robust batch and streaming pipelines.
• Ensure data quality, lineage, and reliability for production ML data.
• Troubleshoot data feeds and ensure uninterrupted data flow.
• Communicate with stakeholders about ML data requirements and delivery.
• Own the data science data development lifecycle from ingestion to serving.

Skills

Python

SQL

Java

Streaming

Data pipelines

Education

Bachelor's degree in CS or Math

Tools

GCP

AWS

BigQuery

Pub/Sub

Dataflow

Datastream

Spark

Flink

Job description

Are you ready to move beyond traditional ETL and build the foundational data systems for data science utilising high-impact machine learning? We're seeking a Data Engineer to design, build, and maintain the near real-time and batch data flows that power our production models.

Responsibilities:

• Collaborate closely with Data Scientists to design, build, and maintain robust, scalable, and reliable batch and streaming data pipelines, serving high-volume data essential for training and deploying data science and ML models in our cloud environment.
• Implement cutting-edge data engineering best practices to guarantee the quality, consistency, and lineage of crucial model training data and feature sets, ensuring high reliability for production data science/ML systems.
• Troubleshoot and resolve complex issues with data feeds, ensuring uninterrupted flow and availability.
• Establish and maintain strong communication channels between Business Stakeholders, Data Scientists and Engineering teams regarding the strategic development and deployment of machine learning projects and the effective use of company data.
• Assume full ownership of the data science data development lifecycle, from raw data ingestion to production model data serving, and possess the ability to work independently when necessary.

At ComeOn, we've embraced a Hybrid Work model, giving our employees the flexibility to work some days at home. Our offices are thoughtfully designed to support this model, featuring practical workspaces for focused efforts and collaborative zones for dynamic creative exchanges. We believe in the power of collaboration to drive innovation and success. While our offices are known for their vibrant atmosphere, rest assured that our primary focus is on achieving results together. We prioritize efficiency and maintain a balance between hard work and camaraderie. When you visit our offices, expect a warm welcome and professional support. Choose ComeOn for your next career move, and experience a workplace that values productivity, teamwork, and the spirit of collaboration.

At ComeOn Group we value diversity, and we take concrete action to ensure fairness in our recruitment process. We are committed to assess candidates on their merit without discriminating against any applicant for whatever reason that is protected by law. We truly value you, as you are. Just visit our website www.comeon-group.com or any of our social media channels to take a deep dive into our culture!

LinkedIn

Instagram

Facebook

Glassdoor

About you:

• Experienced data engineer with 5+ years in data integration & real time streaming
• Experience in programming with Python and SQL, potentially Java
• Understanding data warehousing concepts, schema design (star schema, snowflake schema, denormalization), and optimization techniques
• Experience in distributed frameworks like Spark or Flink
• Experience with GCP (preferred) or AWS Cloud data processing solutions
• Experience with BigQuery, Pub/Sub, Dataflow, Datastream is a plus
• Excellent command of spoken English
• Keen attention to detail and data quality
• Comfortable working in a fast-paced environment whilst interacting with a variety of different disciplines
• Proven ability to prioritise and deal with problems systematically and provide clear communications regarding the issues, resolution times and solutions

And then some nice to haves:

• Hold an academic degree in a quantitative discipline such as computer science or mathematics
• Experience within the iGaming industry and involved in machine learning projects (e.g. personalised Sportsbook and Casino recommendations)
• Previous working experience as machine learning engineer will be considered an asset
• Experience with Airflow Experience in business analysis and requirements gathering

So what can you expect from ComeOn as a place of work?

• A competitive remuneration package inc. a company bonus scheme!
• Fantastic quarterly team events and weekly company events
• A one-time bonus to help you set up a comfortable workstation at home (we’re truly Hybrid!)
• On top of our Hybrid work arrangement, up to 40 days a year to work fully remote from anywhere
• A comprehensive, International private Health Insurance.
• A €250 One-time Hybrid Allowance to help you set-up your home office.