data engineer for customer data platforms

HireHi; Greater London; On-site; GBP 70,000 - 100,000; Full time

Job summary

HireHi в Лондоне ищет инженера по данным для проектирования и поддержки масштабируемых конвейеров данных, трансформации и интеграции данных в разных средах клиента.

Кандидат будет развивать облачные платформы, работать с Databricks/Snowflake, Python и SQL, обеспечивать качество и безопасность данных, а также сотрудничать с архитекторами и аналитиками для формирования эффективных решений.

Qualifications

• Требуется опыт разработки конвейеров данных и ETL/ELT.
• Опыт работы с облачными платформами Databricks/Snowflake, AWS и/или Azure.
• Понимание CDC и моделирования данных.

Responsibilities

• Проектирование и поддержка масштабируемых конвейеров данных.
• Реализация ETL/ELT процессов и интеграций между источниками.
• Разработка моделей данных для аналитики и операций.
• Обеспечение качества данных, мониторинга и observability.
• Сотрудничество с архитекторами, аналитиками и заказчиками для реальных решений.

Skills

Python

SQL

Data pipelines

ETL/ELT

CDC

Tools

Databricks

Snowflake

AWS

Azure

Job description

Описание:

Tecknuovo delivers data solutions that help customers make better use of their data. Its multidisciplinary delivery teams build data pipelines, platforms and integrations, and transfer knowledge so customer teams can own and evolve those solutions.

Задачи:

• Design, build and maintain scalable data pipelines and processing solutions that move and transform data across customer environments
• Deliver ETL/ELT processes and integrations across structured, semi-structured and unstructured data sources
• Build and evolve cloud-based data platforms, applying engineering judgement to performance, scalability, security and maintainability
• Develop data models for analytics, reporting and operational use cases
• Embed data quality, validation, monitoring and observability to identify and resolve issues
• Apply software engineering practices, including version control, automated testing, CI/CD and infrastructure as code
• Collaborate with technical and non-technical stakeholders to understand problems and translate requirements into practical data solutions
• Contribute to technical design decisions, engineering standards and continuous improvement across the delivery team
• Troubleshoot complex data and platform issues, taking ownership through to resolution and communicating with affected people
• Document solutions and share knowledge with customer teams and colleagues
• Develop or improve data pipelines, refine data models, test integrations and investigate solution performance and quality
• Work with architects, analysts and customer stakeholders to understand requirements and agree on technical approaches
• Review code and document key decisions

Требования:

• Demonstrable experience delivering data solutions using Databricks or Snowflake, alongside AWS and/or Azure
• Experience delivering new data lake patterns or transforming existing data lake environments
• Strong understanding of building scalable, secure and maintainable data solutions
• Practical experience with data replication and change data capture (CDC) technologies in large, complex environments
• Experience with Python, SQL, data pipelines, ETL/ELT, data modelling and cloud-based data platforms
• Ability to work through ambiguity, understand customer outcomes and make pragmatic technical decisions
• Clear communication of technical concepts and effective collaboration across multidisciplinary teams
• Ownership of the quality and reliability of delivered solutions
• Будет плюсом: experience with enterprise database products such as Oracle

Условия:

Локация: Лондон