Java/Spark Big Data Developer

Correctcontext; Wrocław; On-site; PLN 200,880 - 279,000; Full time

Benefits offered by this job

Private healthcare

Flexible work time

Free parking

Multikafeteria

Job summary

Correctcontext is seeking a Java/Spark Big Data Developer for Comscore in Poland. The role involves developing and maintaining high-volume data processing pipelines, ensuring scalability and performance. You'll be part of a supportive international team, either working fully remotely or in-office in Wrocław.

The ideal candidate should possess strong Linux skills and a solid understanding of Spark internals, with the ability to debug JVM/Java applications. Additional perks include flexible work hours and private healthcare.

Qualifications

• Experience with distributed systems and backend solutions.
• Solid understanding of algorithms, data structures, and complexity analysis.
• Hands-on experience with debugging in the Java/Spark ecosystem.

Responsibilities

• Develop and maintain Java and Spark-based data processing pipelines.
• Collaborate with cross-functional teams to ensure smooth data flow.
• Troubleshoot and debug issues to improve system stability.

Skills

Linux

Understanding of Spark internals

Debugging JVM/Java

Proactive approach

Tools

Apache Iceberg

Java

Spark

Job description

Correct Context is looking for a Java/Spark Big DataDeveloper for Comscore in Poland and around.

Comscore is a global leader in media analytics, revolutionizing insights into consumer behavior, media consumption, and digital engagement.

Comscore leads in measuring and analyzing audiences across diverse digital platforms. Thrive on using cutting-edge technology, play a vital role as a trusted partner delivering accurate data to global businesses, and collaborate with industry leaders like Facebook, Disney, and Amazon. Contribute to empowering businesses in the digital era across media, advertising, e-commerce, and technology sectors.

We offer:

• Real big data projects, petabytes scale
• An international team
• A small, independent team working environment
• Flexible work time
• Fully remote or in-office work in Wroclaw, Poland
• 18,000 - 25,000 PLN net/month B2B
• Multikafeteria
• Private healthcare
• Free parking

As a Java Developer, you will:

• Taking care of our high-volume (tens of billions of events daily), multi-tenant, and distributed data processing pipelines
• Develop and maintain Java-based and Spark-based Big Data processing pipelines, ensuring scalability and performance
• Work with distributed systems, contributing to the design and implementation of backend solutions
• Collaborate with cross-functional teams to integrate different platforms and ensure smooth data flow
• Troubleshoot and debug issues to improve overall system stability
• Participate in code reviews and offer guidance on best practices
• Debug java/aws/airflow pipelines
• Help team to produce better solutions (teaching/code reviews/showing directions)
• Design high efficient processing pipelines

The candidate must have:

• Linux as a daily driver of operations
• Good understanding of Spark internals and mechanics
• Experience with Apache Iceberg (or similar)
• Solid understanding of algorithms, data structures, and complexity analysis
• Proven ability to debug JVM/Java (hopefully in Spark ecosystem)
• Hands-on, proactive approach

The recruitment process for the Java Developer position has following steps

1. Technical survey ~ 10min
2. Technical screening - 30 min
3. Technical interview - 1h-2h

If you think you’re a good fit, but don’t meet all the qualifications, let’s talk!