Senior Spark & Scala Big Data Engineer | AWS

Diverse CG Sp. z o.o. Sp.k.; Łódź, Gdynia; On-site; PLN 80,000 - 100,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Constant support of dedicated consultant

Job summary

Diverse CG Sp. z o.o. Sp.k. in Łódź, Poland, is seeking a Big Data Engineer with extensive experience in Spark and Scala. The role involves building distributed data processing pipelines, and collaborating with cross-functional teams in a Continuous Delivery environment. Ideal candidates will have strong skills in Python, CI/CD tools, and SQL. Benefits include private medical care and co-financing for a sports card. Candidates should demonstrate a collaborative mindset and be self-motivated.

Qualifications

• 7+ years of experience in Spark & Scala.
• 5+ years of development experience with Python.
• 3+ years experience with CI/CD tools such as Jenkins.

Responsibilities

• Build distributed and highly parallelized BigData processing pipeline.
• Leverage Spark for data enrichment and transformation.
• Work closely with DevOps, QA, and Product Management teams.

Skills

Spark & Scala

Python

Robot Framework

CI/CD tools

AWS

SQL

BitBucket and GIT

Linux and bash

Tools

Jenkins

Bamboo

Jira

Job description

Diverse CG Sp. z o.o. Sp.k. in Łódź, Poland, is seeking a Big Data Engineer with extensive experience in Spark and Scala. The role involves building distributed data processing pipelines, and collaborating with cross-functional teams in a Continuous Delivery environment. Ideal candidates will have strong skills in Python, CI/CD tools, and SQL. Benefits include private medical care and co-financing for a sports card. Candidates should demonstrate a collaborative mindset and be self-motivated.