Data Engineer - Airflow/AWS/Python

Square One Resources; Madrid; Presencial; EUR 41.000 - 47.000; Jornada completa

Descripción de la vacante

Square One Resources is seeking a Data Engineer to join the team in Madrid, working on data pipelines and production workflows. The role focuses on Airflow-based orchestration, Python development, and AWS data processing in a contract capacity.

The successful candidate will bring at least 3 years of data engineering experience, strong Python skills, and a solid understanding of data quality and pipeline reliability in a production environment.

Formación

• 3+ years' commercial experience in Data Engineering.
• Strong Python development skills.
• Hands-on AWS, Apache Airflow and Python.
• Experience with production data pipelines and data quality.
• Familiarity with SQL and relational databases.

Responsabilidades

• Design, develop and maintain scalable data pipelines.
• Develop workflows with Apache Airflow.
• Build data solutions using Python.
• Work with AWS cloud services to support data processing and storage.
• Monitor pipeline performance and troubleshoot issues.
• Provide operational support to the data engineering team.
• Contribute to data quality initiatives and data validation.
• Follow best practices around testing, version control and deployment.
• Collaborate with senior engineers and stakeholders.
• Participate in incident resolution and root-cause analysis.

Conocimientos

Python

AWS

Apache Airflow

SQL

Data pipelines

Data quality

Git

CI/CD

Terraform

Herramientas

Git

Terraform

CI/CD

Descripción del empleo

Job Title: Data Engineer - Airflow/AWS/Python

Location: Madrid Spain

Rate:30-34 Eurios an hour

Start Date: End of September

Job Type: Contract 6 months

We are looking for an experienced Data Engineer with a minimum of 3 years' commercial experience to join our data engineering team. The successful candidate will have strong hands‑on experience with AWS, Apache Airflow and Python, together with a good understanding of data quality and production data pipelines.

You will work closely with senior data engineers and the wider technology team, providing operational support and helping to ensure our data pipelines are reliable, scalable and fit for purpose.

Key Responsibilities

• Design, develop and maintain robust and scalable data pipelines.
• Develop and maintain data workflows using Apache Airflow.
• Build and enhance data engineering solutions using Python.
• Work with AWS cloud services to support data processing, storage and pipeline infrastructure.
• Monitor day‑to‑day pipeline performance and investigate failures or data issues.
• Provide operational support to the senior data engineering team.
• Troubleshoot production data pipeline issues and implement appropriate fixes.
• Contribute to data quality initiatives, including identifying, monitoring and resolving data quality issues.
• Implement data validation and quality checks across pipelines and datasets.
• Support continuous improvements to pipeline reliability, performance and maintainability.
• Collaborate with senior engineers, analysts and other stakeholders to understand data requirements.
• Follow engineering best practices around testing, documentation, version control and deployment.
• Participate in incident resolution and root‑cause analysis where required.

Essential Skills & Experience

• Minimum 3 years' experience in Data Engineering or a closely related role.
• Strong hands‑on Python development experience.
• Practical experience with AWS cloud technologies and services.
• Strong experience using Apache Airflow to develop and manage data workflows.
• Experience working with production data pipelines and supporting operational environments.
• Demonstrable experience delivering or contributing to data quality projects.
• Strong troubleshooting and problem‑solving skills.
• Understanding of data engineering principles, ETL/ELT processes and data pipeline architecture.
• Experience working with relational databases and SQL.
• Familiarity with Git and standard software development practices.
• Ability to work effectively with senior technical colleagues and provide reliable day‑to‑day operational support.

Desirable Experience

• Experience with AWS services such as S3, Lambda, Glue, Redshift or CloudWatch.
• Experience with data quality or data observability tools.
• Experience with CI/CD and automated testing.
• Knowledge of infrastructure‑as‑code technologies such as Terraform.
• Experience working within Agile/Scrum development environments.
• Experience with large-scale or cloud‑based data platforms.

Personal Attributes

• Strong analytical and problem‑solving ability.
• Proactive approach to identifying and resolving issues.
• Comfortable working in a production environment where reliability is important.
• Strong attention to detail, particularly around data accuracy and quality.
• Good communication skills and the ability to work collaboratively with senior team members.
• Willingness to learn new technologies and continuously improve existing processes.
• Able to manage competing priorities while maintaining a high standard of delivery.

Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies. Square One is acting as both an employment agency and an employment business, and is an equal opportunities recruitment business. Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.