Data Engineer

humara; Eastbourne; On-site; GBP 55,000 - 65,000; Full time

Job summary

A data technology company in Eastbourne seeks a skilled mid-Level Data Engineer to develop scalable data pipelines. The candidate will work on real-time data solutions using AWS, Kafka, and Python. Responsibilities include collaborating on architecture plans, managing production Kafka, and building data pipelines. The ideal applicant has solid commercial data engineering experience, excellent Python skills, and proficiency in various data technologies. The role offers a competitive salary and an inclusive work environment.

Benefits

Medicash healthcare scheme

Life insurance scheme

25 days holiday + bank holidays + birthday off

Employee Assistance Programme

Nursery salary sacrifice scheme

Enhanced parental leave

Qualifications

• Solid experience in a mid-level data engineering role.
• Experience with managing Kafka in production.
• Ability to mentor junior colleagues where appropriate.

Responsibilities

• Contribute to data engineering roadmap.
• Collaborate on data architecture plans.
• Support technical requirements development.
• Build and maintain data pipelines.
• Implement best practices in data governance.

Skills

Commercial experience in data engineering

Production-grade Python

Real-time data streaming (Kafka, Google Cloud Pub/Sub)

Stream processing frameworks (Faust, Flink)

Database technologies (Snowflake, PostgreSQL)

Good communication skills

Tools

Docker

Terraform

Kubernetes

Job description

Overview

We are looking for a skilled mid-Level Data Engineer with a passion for building reliable and scalable data pipelines to power cutting-edge genAI products. The ideal person would have strong commercial experience in real-time data engineering and cloud technologies, and be able to apply this expertise to business problems to generate value. We currently work in an AWS, Snowflake, dbt, Looker, Python, Kinesis and Airflow stack and are building out our real-time data streaming capabilities using Kafka. You should be comfortable with these or comparable technologies. As an individual contributor, you will take ownership of well-defined projects, collaborate with senior colleagues on architectural decisions, and contribute to improving data engineering standards, documentation, and team practice. The successful candidate will join our cross functional development teams and actively participate in our agile delivery process. Our dynamic Data & AI team will also support you, and you will benefit from talking data with our other data engineers, data scientists, and ML and analytics engineers.

Responsibilities

• Contribute to our data engineering roadmap.
• Collaborate with senior data engineers on data architecture plans.
• Managing Kafka in production
• Collaborating with cross-functional teams to develop and implement robust, scalable solutions.
• Supporting the elicitation and development of technical requirements.
• Building, maintaining and improving data pipelines and self-service tooling to provide clean, efficient results.
• Develop automated tests and monitoring to ensure data quality and data pipeline reliability.
• Implement best practices in data governance through documentation, observability and controls.
• Using version control and contributing to code reviews.
• Supporting the adoption of tools and best practices across the team.
• Mentoring junior colleagues where appropriate.

Essential Qualifications

• Solid commercial experience in a mid-level data engineering role.
• Excellent production-grade Python skills.
• Previous experience with real-time data streaming platforms such as Kafka/Confluent/Google Cloud Pub/Sub.
• Experience handling and validating real-time data.
• Experience with stream processing frameworks such as Faust/Flink/Kafka Streams, or similar.
• Comfortable with database technologies such as Snowflake/PostgreSQL and NoSQL technologies such as Elasticsearch/MongoDB/Redis or similar.
• Proficient with ELT pipelines and the full data lifecycle, including managing data pipelines over time.
• Good communication skills and the ability to collaborate effectively with engineers, product managers and other internal stakeholders.

Desirable

• An understanding of JavaScript/TypeScript.
• An understanding of Docker.
• Experience with Terraform
• Experience with EKS/Kubernetes
• Experience developing APIs.

Notes: Studies have shown that women and people who are disabled, LGBTQ+, neurodiverse or from ethnic minority backgrounds are less likely to apply for jobs unless they meet every single qualification and criteria. We\'re committed to building a diverse, inclusive, and authentic workplace where everyone can be their best, so if you\'re excited about this role but your past experience doesn\'t align perfectly with every requirement on the Job Description, please apply anyway - you may just be the right candidate for this or other roles in our wider team.

Benefits

Salary up to £65,000

• Medicash healthcare scheme (reclaim costs for dental, physiotherapy, osteopathy and optical care)
• Life Insurance scheme
• 25 days holiday + bank holidays + your birthday off (rising to 28 after 3 consecutive years with the business & 30 after 5 years)
• Employee Assistance Programme (confidential counselling)
• Gogeta nursery salary sacrifice scheme (save up to 40% per year)
• Enhanced parental leave and pay including 26 weeks\' full maternity pay and 8 weeks\' paternity leave