Senior Real-Time Data Engineer (Hybrid)

Quantum; Greater London; Hybrid; GBP 85,000 - 120,000; Full time

Benefits offered by this job

Competitive Base Salary

Company Bonus Scheme

Hybrid Working (3 days in office)

Private Health Care (Bupa)

Travel Insurance

Market Leading Training Programme

Recognition & Reward Scheme

Annual Company Conference

Regular Happy Hour / Team Lunches

Free Coffee, Drinks & Snacks

Job summary

A leading digital comparison service in the UK is seeking a Senior Data Engineer to design and build scalable real-time data pipelines. The role involves integrating data sources, ensuring efficient data flow, and collaborating with teams to support growing data needs. Ideal candidates will have extensive experience in data engineering, cloud platforms, and programming skills in languages such as Python or Java. This position also offers a competitive salary, hybrid working model, and a range of benefits including private health care and training programs.

Qualifications

• Hands-on experience in data engineering with a proven track record.
• Expertise in developing data backbones using distributed streaming platforms.
• Experience with cloud platforms for real-time data ingestion.
• Programming skills in Python, Java, Scala, or similar.
• Proficiency in SQL, NoSQL, and time-series databases.
• Strong understanding of orchestration tools.

Responsibilities

• Design, develop, and maintain scalable real-time data pipelines.
• Integrate various data sources and maintain seamless data flow.
• Build efficient and fault-tolerant data ingestion processes.
• Monitor and improve the performance of data pipelines.
• Collaborate with cross-functional teams to align infrastructure with business goals.

Skills

Data engineering

Real-time data pipelines

Cloud platforms (AWS, GCP, Azure)

Programming skills (Python, Java, Scala)

Database technologies (SQL, NoSQL)

Data pipeline orchestration tools

Team collaboration

Fast-paced environment adaptability

Excellent communication skills

Tools

Kafka

Spark Streaming

Apache Airflow

Kubernetes

Job description

A leading digital comparison service in the UK is seeking a Senior Data Engineer to design and build scalable real-time data pipelines. The role involves integrating data sources, ensuring efficient data flow, and collaborating with teams to support growing data needs. Ideal candidates will have extensive experience in data engineering, cloud platforms, and programming skills in languages such as Python or Java. This position also offers a competitive salary, hybrid working model, and a range of benefits including private health care and training programs.