Senior Data Engineer

ComeOn Group; Katowice; Hybrid; PLN 180,000 - 260,000; Part time

Benefits offered by this job

Hybrid work

Health insurance

Annual bonus

Home office stipend

Remote work up to 40 days/year

Team events

Job summary

ComeOn Group in Poland is seeking a Data Engineer to design, build, and maintain near real-time and batch data pipelines powering production ML models. You will collaborate with Data Scientists to create robust, scalable data flows in our cloud environment.

Hybrid work lets you work from home some days; you’ll own the end-to-end data development lifecycle from ingestion to serving, and work with stakeholders across engineering and business to ensure data quality and reliability.

Qualifications

• 5+ years in data integration and real-time streaming.
• Proficiency in Python and SQL; Java is a plus.
• Strong understanding of data warehousing concepts and schema design.

Responsibilities

• Collaborate with Data Scientists to design and maintain batch and streaming data pipelines.
• Implement best practices to ensure data quality, lineage, and reliability for ML datasets.
• Troubleshoot data feeds and maintain uninterrupted data flow.
• Coordinate with stakeholders across Business, Data Science and Engineering teams.
• Own the data development lifecycle from ingestion to production data serving.

Skills

Data integration

Real-time streaming

Python

SQL

Java

English

Data warehousing

GCP/AWS

BigQuery

Spark/Flink

Education

Degree in quantitative discipline

Tools

Airflow

Pub/Sub

Dataflow

Datastream

BigQuery

Job description

Are you ready to move beyond traditional ETL and build the foundational data systems for data science utilising high-impact machine learning? We're seeking a Data Engineer to design, build, and maintain the near real-time and batch data flows that power our production models.

Responsibilities:

• Collaborate closely with Data Scientists to design, build, and maintain robust, scalable, and reliable batch and streaming data pipelines, serving high-volume data essential for training and deploying data science and ML models in our cloud environment.
• Implement cutting-edge data engineering best practices to guarantee the quality, consistency, and lineage of crucial model training data and feature sets, ensuring high reliability for production data science/ML systems.
• Troubleshoot and resolve complex issues with data feeds, ensuring uninterrupted flow and availability.
• Establish and maintain strong communication channels between Business Stakeholders, Data Scientists and Engineering teams regarding the strategic development and deployment of machine learning projects and the effective use of company data.
• Assume full ownership of the data science data development lifecycle, from raw data ingestion to production model data serving, and possess the ability to work independently when necessary.

At ComeOn, we've embraced a Hybrid Work model, giving our employees the flexibility to work some days at home. Our offices are thoughtfully designed to support this model, featuring practical workspaces for focused efforts and collaborative zones for dynamic creative exchanges. We believe in the power of collaboration to drive innovation and success. While our offices are known for their vibrant atmosphere, rest assured that our primary focus is on achieving results together. We prioritize efficiency and maintain a balance between hard work and camaraderie. When you visit our offices, expect a warm welcome and professional support. Choose ComeOn for your next career move, and experience a workplace that values productivity, teamwork, and the spirit of collaboration.

At ComeOn Group we value diversity, and we take concrete action to ensure fairness in our recruitment process. We are committed to assess candidates on their merit without discriminating against any applicant for whatever reason that is protected by law. We truly value you, as you are. Want to know more about us just visit our website www.comeon-group.com or any of our social media channels to take a deep dive into our culture!

LinkedIn

Instagram

Facebook

Glassdoor

About you:

• Experienced data engineer with 5+ years in data integration & real time streaming
• Experience in programming with Python and SQL, potentially Java
• Understanding data warehousing concepts, schema design (star schema, snowflake schema, denormalization), and optimization techniques
• Experience in distributed frameworks like Spark or Flink
• Experience with GCP (preferred) or AWS Cloud data processing solutions
• Experience with BigQuery, Pub/Sub, Dataflow, Datastream is a plus
• Excellent command of spoken English
• Keen attention to detail and data quality
• Comfortable working in a fast-paced environment whilst interacting with a variety of different disciplines
• Proven ability to prioritise and deal with problems systematically and provide clear communications regarding the issues, resolution times and solutions

And then some nice to haves:

• Hold an academic degree in a quantitative discipline such as computer science or mathematics
• Experience within the iGaming industry and involved in machine learning projects (e.g. personalised Sportsbook and Casino recommendations)
• Previous working experience as machine learning engineer will be considered an asset
• Experience with Airflow Experience in business analysis and requirements gathering

So what can you expect from ComeOn as a place of work?

• A competitive remuneration package inc. a company bonus scheme!
• Fantastic quarterly team events and weekly company events
• A one-time bonus to help you set up a comfortable workstation at home (we're truly Hybrid!)
• On top of our Hybrid work arrangement, up to 40 days a year to work fully remote from anywhere
• A comprehensive, International private Health Insurance.
• A €250 One-time Hybrid Allowance to help you set-up your home office.