Data Engineer

Spait Infotech; United Kingdom; Presencial; GBP 60.000 - 105.000; Tempo integral

Resumo da vaga

Spait Infotech in the United Kingdom is seeking a data engineer to design, develop and maintain data pipelines, and to work with ETL/ELT processes across multiple sources. You will optimize SQL queries, develop Python data processing solutions, and build data warehouses and data lakes while ensuring data quality and governance.

Ideal candidates have experience with Spark / PySpark, cloud platforms (AWS/Azure/GCP), Airflow, and strong collaboration with analysts and data scientists to scale

Qualificações

• Strong knowledge of SQL and database concepts.
• Proficient Python programming for data processing.
• Hands-on experience with ETL/ELT processes.
• Understanding of data warehousing and data modeling.
• Experience with Spark / PySpark.
• Familiarity with cloud platforms (AWS, Azure, or GCP).
• Knowledge of Airflow and version control with Git.
• Strong analytical and communication skills.

Responsabilidades

• Design, develop, and maintain efficient data pipelines.
• Extract, transform, and load data from multiple sources using ETL/ELT processes.
• Write and optimize SQL queries for data processing and analysis.
• Develop data processing solutions using Python.
• Build and maintain data warehouses and data lakes.
• Ensure data accuracy, quality, and consistency.
• Monitor, troubleshoot, and improve data pipeline performance.
• Work with cloud platforms to manage and process large datasets.
• Collaborate with data analysts, data scientists, and other teams.
• Maintain data security and follow data governance standards.

Conhecimentos

SQL proficiency

Python programming

ETL / ELT processes

Data warehousing & modeling

Apache Spark / PySpark

Cloud platforms (AWS/Azure/GCP)

Apache Airflow

Databases (MySQL/PostgreSQL/SQL Server

Git & version control

Analytical & communication skills

Ferramentas

Apache Airflow

Git

SQL tuning

Cloud platforms: AWS/Azure/GCP

PySpark

ETL tooling

Descrição da vaga

• Design, develop, and maintain efficient data pipelines.
• Extract, transform, and load data from multiple sources using ETL/ELT processes.
• Write and optimize SQL queries for data processing and analysis.
• Develop data processing solutions using Python.
• Build and maintain data warehouses and data lakes.
• Ensure data accuracy, quality, and consistency.
• Monitor, troubleshoot, and improve data pipeline performance.
• Work with cloud platforms to manage and process large datasets.
• Collaborate with data analysts, data scientists, and other teams.
• Maintain data security and follow data governance standards.

Required Skills

• Strong knowledge of SQL and database concepts.
• Good programming skills in Python.
• Hands‑on experience with ETL/ELT processes.
• Understanding of Data Warehousing and Data Modeling.
• Knowledge of Apache Spark / PySpark.
• Experience with any one cloud platform: AWS, Azure, or GCP.
• Knowledge of data pipeline orchestration tools like Apache Airflow.
• Understanding of databases such as MySQL, PostgreSQL, or SQL Server.
• Knowledge of Git and version control.
• Good analytical, problem‑solving, and communication skills.