Lead Data Engineer

Retelligence; London; On-site; GBP 100,000 - 110,000; Full time

Job summary

A high-growth digital innovation firm in North London is seeking a Lead Data Engineer to design and maintain scalable data pipelines. The role includes optimizing performance and data quality, leveraging Google Cloud Platform and advanced tools. This position offers a salary between £100,000 and £110,000 per annum plus bonus, emphasizing career development and innovation.

Qualifications

• Strong hands-on experience in data engineering with expertise in Python.
• Proven track record of building and managing data pipelines.
• In-depth experience with Google Cloud Platform (GCP) and its associated tools.

Responsibilities

• Design, develop, and maintain scalable data pipelines and infrastructure.
• Integrate multiple data sources to ensure seamless data flow.
• Build and optimize data models for querying and analytics.

Skills

Expertise in Python

Data pipeline management

Knowledge of Google Cloud Platform

Experience with SQL

Familiarity with Kafka

Data orchestration tools

Problem-solving skills

Job description

Overview

Lead Data Engineer. Location: North London. Salary/Rate: £100,000 - £110,000 per annum + Bonus. Company: Retelligence. Retelligence is partnering with a high-growth, forward-thinking organization that specializes in digital innovation and marketing across international markets. The company is on an exciting journey, rapidly scaling its capabilities and leveraging advanced technology to deliver cutting-edge solutions. Join a dynamic team within a business that values innovation, supports professional development, and offers exceptional career progression.

Responsibilities

• Design, develop, and maintain scalable data pipelines and infrastructure in a Google Cloud Platform (GCP) environment.
• Integrate multiple data sources to ensure seamless data flow across the organization.
• Build and optimize data models for querying and analytics use cases.
• Develop fault-tolerant, highly available data ingestion and processing pipelines.
• Continuously monitor and improve pipeline performance for low-latency and high-throughput operations.
• Ensure data quality, integrity, and security across all systems.
• Implement effective monitoring, logging, and alerting mechanisms.
• Collaborate with product, engineering, and analytics teams to deliver tailored solutions that meet business needs.

Qualifications

• Strong hands-on experience in data engineering with expertise in Python.
• Proven track record of building and managing data pipelines.
• In-depth experience with Google Cloud Platform (GCP) and its associated tools for data ingestion and processing.
• Familiarity with distributed streaming platforms such as Kafka or similar technologies.
• Advanced knowledge of SQL.
• Experience with data orchestration tools.
• Ability to optimize and refactor data pipelines for improved performance and scalability.
• Strong problem-solving skills and the ability to thrive in a collaborative, fast-paced environment.