Data engineer for machine learning

Solirius Reply; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Benefits offered by this job

Competitive Salary

Bonus Scheme

Private Healthcare Insurance

25 Days Annual Leave + Bank Holidays

Up to 10 days allocated for developm​t

Enhanced Parental Leave

Paid Fertility Leave (5 Days)

Contributory Pension

EAP with Membership Benefits

Flexible Benefits Allowance

Cycle to Work and Electric Vehicle

Flexible Working

Annual Away Days/Company Socials

Job summary

Solirius Reply, входящая в группу Reply, является технологическим консультантом и партнером по цифровой трансформации, помогающим организациям решать задачи через стратегию, дизайн, инжиниринг и реализацию. Мы сотрудничаем с клиентами над созданием безопасных, доступных и ориентированных на пользователя сервисов.

Мы ищем специалиста по данным с опытом работы в инженерных командах и руководством. Указывается гибридный формат работы и конкурентная компенсация с возможностью обучения и развития.

Qualifications

• Опыт работы в командах Data Engineering и лидерстве.
• Опыт работы в облачной инфраструктуре (Azure или AWS; GCP желательно).
• SQL и реляционные базы данных (MS SQL/Azure SQL, PostgreSQL).
• Фреймворки Flask, Tornado или Django; Docker.
• Big data: Apache Spark, Hadoop, Kafka.
• Сбор данных и разработка наборов данных, повышение качества данных.
• Практическое владение Python.
• Reporting: Tableau, PowerBI, Qlik.
• Опыт работы в Agile среде.
• Опыт в архитектуре данных.
• Будет плюсом: ETL конвейеры (Luigi, Airflow, Argo); GDPR.

Responsibilities

• Разработка Data Engineering решений для клиентов.
• Проектирование моделей данных и схем для бизнес-требований.
• Разработка и поддержка систем ingestion и обработки данных с использованием SQL, NoSQL, ETL инструментов.
• Реализация хранилищ данных в реляционных и нереляционных базах; облако.
• Сотрудничество с клиентами и межфункциональными командами.
• Определение SLA для наборов данных и процессов в продакшене.
• Лидерство в дизайне, сборке и запуске новых моделей и конвейеров.
• Мониторинг трендов в стеке данных и облачных технологиях.

Skills

Python

SQL

MS SQL

PostgreSQL

NoSQL

ETL

Luigi

Airflow

Argo

Flask

Django

Docker

Apache Spark

Hadoop

Kafka

Tableau

PowerBI

Qlik

Data modeling

Data quality

Agile

Data architecture

Tools

Azure

AWS

GCP

Job description

Описание:

Solirius Reply, part of the Reply Group, is a technology consultancy and digital transformation partner that helps organisations solve complex challenges through strategy, design, engineering, and delivery.We work closely with our clients to deliver secure, accessible, user-focused services that evolve with their needs. By combining deep technical expertise with people-centred design, we create solutions that deliver meaningful, lasting impact.

Задачи:

Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data ingestion and processing systems using various tools and technologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc. Implement data storage solutions using different types of databases, such as relational, non-relational, or cloud-based. Working collaboratively with the client and cross-functional teams to identify and address data-related issues and opportunities. Stay updated with the latest trends and developments in the data engineering field, such as modern data stack, big data technologies, cloud computing, etc Assist with defining the processes needed to achieve operational excellence Ensure data quality across all projects/clients Define and manage SLA’s for data sets and processes throughout production Lead on the design, build and launch of new data models and pipelines

Требования:

Experience in operating as part of data engineering teams and independently. Line/Team management experience, leadership experience Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial) SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL) You have framework experience within either Flask, Tornado or Django, Docker Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc. Data acquisition and development of data sets and improving data quality Preparing data for predictive and prescriptive modelling Hands on coding experience, such as Python Reporting tools (e.g. Tableau, PowerBI, Qlik) Passionate, motivated and enthusiastic about developing technology solutions. Experience working in an Agile development environment Data architecture experience. Будет плюсом: Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo; GDPR and Government Service Standard (desirable)

Условия:

• Competitive Salary


• Bonus Scheme


• Private Healthcare Insurance


• 25 Days Annual Leave + Bank Holidays


• Up to 10 days allocated for development training per year


• Enhanced Parental Leave


• Paid Fertility Leave (5 Days)


• Contributory Pension


• EAP with Membership Benefits


• Flexible Benefits Allowance


• Cycle to Work and Electric Vehicle schemes


• Flexible Working


• Annual Away Days/Company Socials