Senior ML Engineer - MLOps, Spark & AWS Expert

Diverse CG Sp. z o.o. Sp.k.; Warszawa; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Dedicated consultant support

Job summary

DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets.

The role involves collaboration with data scientists, DevOps, and IT to deliver high-quality ML solutions, plus engaging with analysts and stakeholders to shape analytics models. Strong English and AWS experience are essential.

Qualifications

• 5+ years of Python and Spark experience.
• Hands-on AWS ML/data processing with S3, Glue, SageMaker, Lambda, and Step Functions/Airflow/MWAA.
• Experience configuring AWS infrastructure with CLI, boto3 and IAM.
• Strong foundations in algorithms, data structures, statistics and linear algebra.
• Experience with TensorFlow or PyTorch for training and deploying ML models.
• Experience with Hadoop/Hive or other Big Data technologies.
• SQL proficiency (Spark/Hive SQL) and data flows.
• Version control with Bitbucket and Git; agile experience (SAFe).
• Excellent English communication skills.

Responsibilities

• Manage lifecycle of ML models from development to deployment and monitoring.
• Implement MLOps principles for CI/CD, testing, and monitoring.
• Work with Spark & Python for data ingestion and transformation (real-time and batch).
• Build distributed, parallel data processing pipelines for massive data sets.
• Use Spark to enrich data for searching, visualization, and analytics.
• Collaborate with data scientists, DevOps, and IT to deliver ML solutions.
• Engage with analysts and stakeholders to develop analytics models.
• Help optimize MLOps practices across wider use cases.

Skills

Python

Spark

AWS

SQL

Git

Machine Learning

Distributed systems

Statistics & linear algebra

English

Agile/SAFe

Tools

SageMaker

Airflow

MWAA

Hive

Spark SQL

Job description

DCG seeks an experienced ML Engineer to manage the lifecycle of ML models from development to deployment and monitoring. You will implement MLOps, work with Spark and Python for data ingestion, and build distributed pipelines for massive datasets.

The role involves collaboration with data scientists, DevOps, and IT to deliver high-quality ML solutions, plus engaging with analysts and stakeholders to shape analytics models. Strong English and AWS experience are essential.