Senior Big Data Engineer

Gaming Innovation Group; Newcastle upon Tyne; Hybrid; EUR 40,000 - 80,000; Full time

Job summary

An innovative company is seeking a passionate Big Data Engineer to join their dynamic team. In this role, you will leverage cutting-edge technologies to manage and enhance a data platform that processes thousands of messages per second. Your expertise in Java and data modelling will be crucial as you collaborate with various teams, ensuring the delivery of world-class product increments. With a strong focus on career development, this organization offers a flexible working model and unique perks, making it an exciting opportunity for those looking to make a significant impact in the tech industry.

Benefits

International Health Insurance

Health and Wellbeing Package (350 EUR per year)

Birthday Day Off

Me Time - 1 day off per year

Free lunches in the office

Great career development opportunities

Qualifications

• Experience in object-oriented programming and data modelling.
• Familiarity with ETL processes and Apache technologies.

Responsibilities

• Collaborate with agile teams to enhance data platforms.
• Maintain and add features to high-throughput data ingestion systems.

Skills

Object-oriented programming (Java)

Data modelling using various database technologies

ETL processes

Apache Spark

CI/CD

Dockerized applications

Distributed version control systems

Team collaboration

Analytical mindset

Education

Bachelor's Degree in Computer Science

Tools

Apache NiFi

ClickHouse

Linux

Windows

Job description

2 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

As part of the Big Data Team, you will be using cutting-edge technologies to work on collating data across different sources within GiG. Sources are all in real time, and you will be supporting an event-driven microservice Lambda architecture.

Your focus is to work with the current agile team, contribute to the platform's objectives, and enable other data technology stakeholders such as Business Intelligence, Data Science, and Quality Assurance teams. You will be tasked with maintaining and adding new features to a platform that ingests up to 5000 messages per second across multiple products such as Lottery, Sports, and Casino.

Reporting to the Lead Big Data Engineer and supported by the Big Data Architect, you will follow best practices to deliver world-class product increments supporting our Tier 1 Platform.

You're really awesome at:

• Object-oriented programming (Java)
• Data modelling using various database technologies
• ETL processes (transferring data in-memory, modern approach) and experience with Apache Spark or Apache NiFi
• Applied understanding of CI/CD in change management
• Dockerized applications
• Using distributed version control systems
• Excellent team player
• Meticulous and passionate about your work

You're also good at:

• Functional programming (experience with Python, Scala)
• Analytical mindset
• Low latency databases such as ClickHouse
• Holding a Bachelor's Degree in Computer Science or equivalent
• Collaborating in scoping exercises
• Mentoring skills
• Working with Linux and Windows environments

What will you get in this role?

You'll share your ideas and knowledge, and if we're a good match, we'll offer you a competitive salary and industry perks like daily lunch. You'll work with top industry talent.

Benefits:

• Great career development opportunities
• 100% remote or hybrid working model
• International Health Insurance
• Health and Wellbeing Package (350 EUR per year)
• Birthday Day Off
• Me Time - 1 day off per year
• Free lunches in the office

Additional Benefits:

• Great career development opportunities
• Hybrid or remote working model
• International Health Insurance
• Health and Wellbeing Package (350 EUR per year)
• Birthday Day Off
• Me Time - 1 day off per year

Seniority level

• Associate

Employment type

• Full-time

Job function

• Engineering and Information Technology

Industries

• IT Services and IT Consulting