Senior Data Engineer - Real-Time ETL & ML Ops (Hybrid)

Atlantic Talent Recruitment; Manchester; Hybrid; GBP 70,000 - 100,000; Full time

Benefits offered by this job

Hybrid working environment

Private health care

Professional development opportunities

Technology equipment for home working

Job summary

Atlantic Talent Recruitment is partnering with a dynamic telecom company in Manchester to hire a senior data engineer. The role focuses on designing and maintaining ETL pipelines, real-time data processing with Apache Kafka, and collaborating with data scientists and architects to scale data solutions.

The ideal candidate has 5+ years in data engineering, MSc/BS in CS or Data Science, strong AWS experience, and solid Java/Python coding skills.

Qualifications

• Bachelor’s and MSc in Computer Science, Data Science, or a related field.
• Proficient in data warehousing, relational databases, and ETL technologies.
• Confident using cloud platform AWS, strong programming skills in Java and Python, and working knowledge of Apache Kafka.
• Experience implementing security measures for data at rest and in transit.

Responsibilities

• Hybrid role requiring a minimum of 2 days in the Manchester office each week.
• Design, build, and maintain ETL pipelines.
• Collaborate with data scientists to operationalise ML models, and data architects and analysts to determine design needs.
• Develop real-time data processing solutions using Apache Kafka.
• Provide guidance and mentorship to junior engineers within the team.
• Ensure data compliance and security needs are met during system development and be available to troubleshoot data management issues across teams.

Skills

Data engineering

Data warehousing

ETL processes

Java

Python

Apache Kafka

Security measures

Education

BSc in Computer Science/Data Science

MSc in Computer Science/Data Science

Tools

AWS

SQL

Job description

Atlantic Talent Recruitment is partnering with a dynamic telecom company in Manchester to hire a senior data engineer. The role focuses on designing and maintaining ETL pipelines, real-time data processing with Apache Kafka, and collaborating with data scientists and architects to scale data solutions.

The ideal candidate has 5+ years in data engineering, MSc/BS in CS or Data Science, strong AWS experience, and solid Java/Python coding skills.