Data engineer

Royal Mail; Greater London; On-site; GBP 85,000 - 110,000; Full time

Benefits offered by this job

Competitive salary

Car allowance

Healthcare

Annual bonus up to 18%

Pension with CDC

25 days leave

Job summary

Royal Mail ищет Senior Data Engineer для формирования и реализации стратегии данных в одном из крупнейших национальных организаций Великобритании. Ваша роль — проектирование и построение масштабируемых data-продуктов, внедрение ML/AI и обеспечение надёжности CI/CD процессов.

Работа с командами Data Analytics, Data Science и Technology, а также взаимодействие с бизнес-стейкхолдерами для достижения бизнес-ценности и трансформации данных в масштабах страны.

Qualifications

• Значительный опыт Data Engineering, создание Production-grade решений
• Опыт работы с Python или Scala
• Опыт работы с Spark и Kafka
• Опыт проектирования моделей данных, ETL/ELT, data warehouses и lakes
• Навык работы с инструментами Google Cloud: BigQuery, Dataflow, Dataproc, Pub/Sub, Composer и Dataplex (или Azure/AWS аналогичные сервисы)
• Сильные знания SQL, управления метаданными и data governance
• Опыт работы с CI/CD, Kubernetes, релиз-менеджментом и облачными развертываниями
• Техники TDD/BDD
• Опыт Jira/Confluence в Agile
• Опыт ML/AI deployment (MLOps)
• Умение работать в многооблачной среде (GCP/Azure/AWS)
• Сильная коммуникация и взаимодействие с заинтересованными сторонами
• Структурированный подход к решению задач, способность конструктивно бросать вызов
• Опыт наставничества инженеров
• Дополнительным преимуществом будет степень/сертификация по Google Cloud

Responsibilities

• Разрабатывать и внедрять масштабируемые конвейеры данных и продукты с ощутимой бизнес-ценностью
• Проектировать и оптимизировать облачную data-платформу (GCP)
• Стандартизировать подходы к ingest/processing/storage/analysis данных
• Руководить командами по добыче, трансформации и доставке данных для операций и принятия решений
• Обеспечивать полный lifecycle data продуктов: концепция, дизайн, доставка, BAU
• Сотрудничать с Data Scientists и ML-инженерами для продакшн-активации ML/AI
• Развивать CI/CD, инфраструктуру и конфигурации, автоматизацию
• Управлять приоритетами, ресурсами и оценками доставки
• Работать с Product Owners и стейкхолдерами для решения технических задач
• Поддерживать пилоты и инновации в организации
• Документировать продукты и передавать их внутренним командам/поставщикам
• Наставлять инженеров и повышать инженерные стандарты

Skills

Python

Scala

Spark

Kafka

SQL

Data modelling

Data warehouses

Data lakes

GCP

Dataflow

Dataproc

Pub/Sub

Composer

Dataplex

CI/CD

Kubernetes

TDD/BDD

MLOps

Jira/Confluence

Education

Высшее образование или эквивалент

Tools

BigQuery

Dataflow

Dataproc

Pub/Sub

Composer

Dataplex

Azure

AWS

Job description

Описание

Royal Mail is transforming how it uses data and technology to improve efficiency, support better decision-making and create value for our customers and colleagues. We're looking for a Senior Data Engineer to play a pivotal role in delivering our data strategy. Working closely with Data Analytics, Data Science, Machine Learning Engineering and Technology teams, you'll help design and build scalable data products that solve real business challenges across one of the UK's largest and most complex organisations.

Задачи

• Leading the design, development and delivery of scalable data pipelines and products that create measurable business value.
• Designing, optimising and monitoring our cloud data platform, with a particular focus on Google Cloud Platform.
• Establishing simple, standardised and innovative approaches to ingesting, processing, storing and analysing data.
• Leading teams responsible for sourcing, transforming and delivering data that supports frontline operations and strategic decision-making.
• Owning the technical lifecycle of data products, from initial concept and design through to delivery, incident management and BAU support.
• Working with Data Scientists and Machine Learning Engineers to deploy machine learning and AI use cases into production.
• Building automation across CI/CD pipelines, testing, infrastructure management, release processes and configuration.
• Overseeing technical priorities, resource allocation and delivery estimates across the data product portfolio.
• Working with Product Owners, Delivery Managers and business stakeholders to resolve technical challenges and deliver agreed outcomes.
• Supporting pilot and innovation activity across the organisation.
• Ensuring data products are documented effectively and handed over smoothly to internal teams and suppliers.
• Coaching and mentoring Data Engineers while promoting engineering best practice and reducing technical debt.

Требования

You’ll be an experienced Data Engineer with a strong track record of building and delivering production-ready data solutions in complex environments. Significant Data Engineering experience, with evidence of delivering solutions that have created measurable business value. Strong experience using Python or Scala. Hands-on knowledge of Big Data and streaming technologies such as Spark and Kafka. Experience designing data models, ETL and ELT pipelines, data warehouses and data lakes. Practical experience with Google Cloud tools such as BigQuery, Dataflow, Dataproc, Pub/Sub, Composer and Dataplex, or comparable services within Azure or AWS. Strong knowledge of SQL, databases, metadata management and data governance. Experience working with CI/CD toolsets, Kubernetes, release management, automated testing and cloud deployments. Knowledge of test-driven or behaviour-driven development practices, including TDD and BDD. Experience using tools such as Jira and Confluence within Agile delivery environments. An understanding of MLOps practices and how data engineering supports scalable machine learning and AI deployment. Experience managing distributed applications across cloud environments, ideally including Google Cloud Platform and Microsoft Azure. Strong communication and stakeholder management skills, with the ability to explain complex technical topics clearly. A structured and analytical approach to solving problems, with the confidence to challenge constructively. Experience coaching or mentoring engineers and improving technical standards across a team. Будет плюсом: A relevant degree or recognised Cloud Engineering certifications, ideally relating to Google Cloud, would also be valuable.

Условия

• Competitive salary
• Car allowance
• Healthcare
• Up to 18% annual bonus potential
• 25 days annual leave plus bank holidays rising with service
• Pension: access to the UK's only Collective Defined Contribution scheme with industry-leading Royal Mail contributions of over 12%, flexible options to boost your savings, and a guaranteed retirement lump sum*
• Build data products with impact across a large and complex national organisation.
• Work with modern cloud, data engineering, machine learning and automation technologies.
• Influence engineering standards and the future direction of our data platform.
• Collaborate with Data Scientists, Machine Learning Engineers, Analysts and Technology specialists.
• Develop other engineers and help grow Royal Mail's internal data capability.
• Take on a visible role within a business investing in data-led transformation.
• Family friendly support - enhanced maternity pay, paternity leave, adoption leave and shared parental leave
• Supportive and generous company sick pay
• Funded Dental - As a manager you are eligible to a level of employer funded dental insurance
• Health Assessment - As a manager you are eligible to an employer funded health assessment every 2 years
• Benefits Account - With more than 800 retail offers to help you save on things like groceries, days out, holidays and your household bills as well as employer provided and voluntary benefits to suit your lifestyle.
• Your Wellbeing - you and your family have 24/7 access to a range of free services and tools, offering support for physical and mental wellbeing, financial guidance, and social support whenever you need it.
• Eligible for enrolment in NEST pension plan after 3 months service and CDC pension scheme after 12 months service
• Available only to permanent employees