Junior Data Engineer: Real-Time Streaming & ML Pipelines

Inetum; Warsaw (IN); Hybrid; USD 24,000 - 35,000; Full time

Benefits offered by this job

Hybrid work model

Cafeteria benefits

Up to PLN6,000 referral bonuses

Revenue sharing opportunities

Dedicated team mentoring

Job summary

Inetum Polska is seeking a Junior Data Engineer to help transform batch inference workflows into streaming pipelines, enabling real-time data processing for ML models. You will work closely with Data Scientists, be responsible for production data pipelines, and operate in a distributed delivery model with the central AI/BI team in Germany.

This hybrid role based in Warszawa/Poznań/Lublin offers exposure to Kafka, Spark Structured Streaming, Kubernetes, and Python, with collaboration via MS

Qualifications

• Experience with Kafka and streaming pipelines in production.
• Hands-on with Spark Structured Streaming or similar.
• Experience migrating batch inference to streaming architectures.
• Experience with containerized workloads in Kubernetes.
• Strong Python skills and ML libraries.
• English and Polish at least B1 level.

Responsibilities

• Transform batch inference workflows into streaming pipelines.
• Define streaming semantics: micro-batching, windowing, state management.
• Design Kafka topic structures, partitions, and consumer groups for prediction workloads.
• Implement checkpointing, backpressure, and delivery guarantees (at-least-once / exactly-once).
• Package and version ML model artifacts for streaming jobs, supporting rollouts/rollbacks.
• Tune performance for throughput and latency, including batching strategies and resource allocation.
• Deploy and operate streaming jobs with monitoring and alerting (lag, throughput, errors).
• Integrate streaming outputs into downstream ETL/BI systems.
• Collaborate with Data Scientists on CI/CD for streaming models and monitor performance/drift.
• Work in a distributed delivery model with the central AI/BI team in Germany.
• Daily collaboration via MS Teams, Jira, Confluence.

Skills

Kafka

Spark Structured Streaming

Python

Kubernetes

English/Polish B1+

Tools

Jira

Confluence

Kubernetes

CI/CD tools

Job description

Inetum Polska is seeking a Junior Data Engineer to help transform batch inference workflows into streaming pipelines, enabling real-time data processing for ML models. You will work closely with Data Scientists, be responsible for production data pipelines, and operate in a distributed delivery model with the central AI/BI team in Germany.

This hybrid role based in Warszawa/Poznań/Lublin offers exposure to Kafka, Spark Structured Streaming, Kubernetes, and Python, with collaboration via MS