Senior Spark & Scala Big Data Engineer | AWS

Diverse CG Sp. z o.o. Sp.k.; Łódź, Gdynia; Vor Ort; PLN 80.000 - 100.000; Vollzeit

Benefits dieser Stelle

Private medical care

Co-financing for the sports card

Constant support of dedicated consultant

Zusammenfassung

Diverse CG Sp. z o.o. Sp.k. in Łódź, Poland, is seeking a Big Data Engineer with extensive experience in Spark and Scala. The role involves building distributed data processing pipelines, and collaborating with cross-functional teams in a Continuous Delivery environment. Ideal candidates will have strong skills in Python, CI/CD tools, and SQL. Benefits include private medical care and co-financing for a sports card. Candidates should demonstrate a collaborative mindset and be self-motivated.

Qualifikationen

• 7+ years of experience in Spark & Scala.
• 5+ years of development experience with Python.
• 3+ years experience with CI/CD tools such as Jenkins.

Aufgaben

• Build distributed and highly parallelized BigData processing pipeline.
• Leverage Spark for data enrichment and transformation.
• Work closely with DevOps, QA, and Product Management teams.

Kenntnisse

Spark & Scala

Python

Robot Framework

CI/CD tools

AWS

SQL

BitBucket and GIT

Linux and bash

Tools

Jenkins

Bamboo

Jira

Jobbeschreibung

Diverse CG Sp. z o.o. Sp.k. in Łódź, Poland, is seeking a Big Data Engineer with extensive experience in Spark and Scala. The role involves building distributed data processing pipelines, and collaborating with cross-functional teams in a Continuous Delivery environment. Ideal candidates will have strong skills in Python, CI/CD tools, and SQL. Benefits include private medical care and co-financing for a sports card. Candidates should demonstrate a collaborative mindset and be self-motivated.