Data Engineer: AI-Driven Data Pipelines in London

DoorFeed; Greater London; On-site; GBP 50,000 - 70,000; Full time

Job summary

A leading data technology firm in London is seeking an experienced Data Engineer to design and maintain data pipelines for property listings. The role demands proficiency in Python, SQL, and pandas, along with 2+ years of professional experience. Ideal candidates will be familiar with ETL processes and AWS services. This full-time position requires on-site attendance five days a week, and offers the chance to work with cutting-edge AI and machine learning technologies.

Qualifications

• Minimum 2 years of relevant professional experience.
• Understanding of ETL processes and data warehousing.
• Comfortable with learning and applying new technologies.

Responsibilities

• Maintain and improve our data pipeline of live properties.
• Manage PostgreSQL databases.
• Use data processing tools to transform data from various sources.
• Build data ingestion pipelines from various data sources.

Skills

Python

SQL

pandas

Problem-solving

Communication skills

Tools

PostgreSQL

AWS (S3, RDS, Lambda, EC2, Athena)

Data orchestration tools (Airflow, Dagster)

Job description

A leading data technology firm in London is seeking an experienced Data Engineer to design and maintain data pipelines for property listings. The role demands proficiency in Python, SQL, and pandas, along with 2+ years of professional experience. Ideal candidates will be familiar with ETL processes and AWS services. This full-time position requires on-site attendance five days a week, and offers the chance to work with cutting-edge AI and machine learning technologies.