Data Engineer - AI-Driven Pipelines (London)

DoorFeed; Greater London; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading data solutions provider is seeking a skilled Data Engineer to join their London office. The candidate will design, build, and maintain data pipelines, process data from numerous sources, and leverage AI and machine learning to enhance data quality. Critical qualifications include proficiency in Python and SQL, along with at least 2 years of relevant experience in data engineering. This role requires the ability to work onsite 5 days a week and will involve managing PostgreSQL databases and data transformation processes.

Qualifications

• Minimum 2 years relevant professional experience in data engineering.
• Able to work onsite in central London office 5 days a week.

Responsibilities

• Maintain and improve data pipeline of live properties.
• Manage PostgreSQL databases.
• Transform data from hundreds of different sources.
• Enrich data using AI and Machine Learning.
• Build data ingestion pipelines from scratch.

Skills

Python

SQL

pandas

data engineering technologies

problem-solving

communication skills

Tools

PostgreSQL

AWS (S3, RDS, Lambda, EC2, Athena)

machine learning frameworks

data orchestration tools (Airflow, Dagster)

Job description

A leading data solutions provider is seeking a skilled Data Engineer to join their London office. The candidate will design, build, and maintain data pipelines, process data from numerous sources, and leverage AI and machine learning to enhance data quality. Critical qualifications include proficiency in Python and SQL, along with at least 2 years of relevant experience in data engineering. This role requires the ability to work onsite 5 days a week and will involve managing PostgreSQL databases and data transformation processes.