Data Engineer: Build Scalable Pipelines & Data Lakes

Spait Infotech; United Kingdom; On-site; GBP 60,000 - 105,000; Full time

Job summary

Spait Infotech in the United Kingdom is seeking a data engineer to design, develop and maintain data pipelines, and to work with ETL/ELT processes across multiple sources. You will optimize SQL queries, develop Python data processing solutions, and build data warehouses and data lakes while ensuring data quality and governance.

Ideal candidates have experience with Spark / PySpark, cloud platforms (AWS/Azure/GCP), Airflow, and strong collaboration with analysts and data scientists to scale

Qualifications

• Strong knowledge of SQL and database concepts.
• Proficient Python programming for data processing.
• Hands-on experience with ETL/ELT processes.
• Understanding of data warehousing and data modeling.
• Experience with Spark / PySpark.
• Familiarity with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Airflow and version control with Git.
• Strong analytical and communication skills.

Responsibilities

• Design, develop, and maintain efficient data pipelines.
• Extract, transform, and load data from multiple sources using ETL/ELT processes.
• Write and optimize SQL queries for data processing and analysis.
• Develop data processing solutions using Python.
• Build and maintain data warehouses and data lakes.
• Ensure data accuracy, quality, and consistency.
• Monitor, troubleshoot, and improve data pipeline performance.
• Work with cloud platforms to manage and process large datasets.
• Collaborate with data analysts, data scientists, and other teams.
• Maintain data security and follow data governance standards.

Skills

SQL proficiency

Python programming

ETL / ELT processes

Data warehousing & modeling

Apache Spark / PySpark

Cloud platforms (AWS/Azure/GCP)

Apache Airflow

Databases (MySQL/PostgreSQL/SQL Server

Git & version control

Analytical & communication skills

Tools

Apache Airflow

Git

SQL tuning

Cloud platforms: AWS/Azure/GCP

PySpark

ETL tooling

Job description

Spait Infotech in the United Kingdom is seeking a data engineer to design, develop and maintain data pipelines, and to work with ETL/ELT processes across multiple sources. You will optimize SQL queries, develop Python data processing solutions, and build data warehouses and data lakes while ensuring data quality and governance.

Ideal candidates have experience with Spark / PySpark, cloud platforms (AWS/Azure/GCP), Airflow, and strong collaboration with analysts and data scientists to scale