Data Engineer - Airflow / AWS / Python

Square One Resources; Madrid; Presencial; EUR 41.000 - 47.000; Jornada completa

Descripción de la vacante

Square One Resources is seeking a Data Engineer for a 6-month contract in Madrid. The role focuses on building robust data pipelines using Python, Airflow and AWS, with a strong emphasis on data quality and reliability.

The candidate will design, implement and maintain scalable data workflows, collaborate with senior engineers, and ensure production pipelines meet performance and governance standards in a fast-paced environment.

Formación

• Minimum 3 years' experience in Data Engineering or related role.
• Strong hands-on Python development experience.
• Practical experience with AWS cloud technologies and services.
• Strong experience using Apache Airflow to develop and manage data workflows.
• Experience with production data pipelines and supporting operational environments.
• Demonstrable experience delivering or contributing to data quality projects.
• Strong troubleshooting and problem-solving skills.
• Understanding of data engineering principles, ETL/ELT processes and data pipeline architecture.
• Experience working with relational databases and SQL.
• Familiarity with Git and standard software development practices.

Responsabilidades

• Design, develop and maintain robust data pipelines.
• Develop data workflows with Apache Airflow.
• Build data solutions using Python.
• Utilize AWS cloud services for pipelines.
• Monitor performance and investigate issues.
• Provide day-to-day operational support.
• Implement data validation and quality checks.
• Follow testing, docs and version control practices.
• Collaborate with stakeholders on data requirements.
• Contribute to incident resolution and RCA.

Conocimientos

Python

SQL

Data Pipelines

GIT

Troubleshooting

Herramientas

Airflow

AWS

Descripción del empleo

Job Title: Data Engineer - Airflow / AWS / Python
Location: Madrid Spain
Rate:30-34 Eurios an hour
Start Date: End of September
Job Type: Contract 6 months

We are looking for an experienced Data Engineer with a minimum of 3 years' commercial experience to join our data engineering team. The successful candidate will have strong hands-on experience with AWS, Apache Airflow and Python, together with a good understanding of data quality and production data pipelines.

You will work closely with senior data engineers and the wider technology team, providing operational support and helping to ensure our data pipelines are reliable, scalable and fit for purpose.

Key Responsibilities

• Design, develop and maintain robust and scalable data pipelines.
• Develop and maintain data workflows using Apache Airflow.
• Build and enhance data engineering solutions using Python.
• Work with AWS cloud services to support data processing, storage and pipeline infrastructure.
• Monitor day-to-day pipeline performance and investigate failures or data issues.
• Provide operational support to the senior data engineering team.
• Troubleshoot production data pipeline issues and implement appropriate fixes.
• Contribute to data quality initiatives, including identifying, monitoring and resolving data quality issues.
• Implement data validation and quality checks across pipelines and datasets.
• Support continuous improvements to pipeline reliability, performance and maintainability.
• Collaborate with senior engineers, analysts and other stakeholders to understand data requirements.
• Follow engineering best practices around testing, documentation, version control and deployment.
• Participate in incident resolution and root-cause analysis where required.

Essential Skills & Experience

• Minimum 3 years' experience in Data Engineering or a closely related role.
• Strong hands-on Python development experience.
• Practical experience with AWS cloud technologies and services.
• Strong experience using Apache Airflow to develop and manage data workflows.
• Experience working with production data pipelines and supporting operational environments.
• Demonstrable experience delivering or contributing to data quality projects.
• Strong troubleshooting and problem-solving skills.
• Understanding of data engineering principles, ETL/ELT processes and data pipeline architecture.
• Experience working with relational databases and SQL.
• Familiarity with Git and standard software development practices.
• Ability to work effectively with senior technical colleagues and provide reliable day-to-day operational support.

Desirable Experience

• Experience with AWS services such as S3, Lambda, Glue, Redshift or CloudWatch.
• Experience with data quality or data observability tools.
• Experience with CI/CD and automated testing.
• Knowledge of infrastructure-as-code technologies such as Terraform.
• Experience working within Agile/Scrum development environments.
• Experience with large-scale or cloud-based data platforms.

Personal Attributes

• Strong analytical and problem-solving ability.
• Proactive approach to identifying and resolving issues.
• Comfortable working in a production environment where reliability is important.
• Strong attention to detail, particularly around data accuracy and quality.
• Good communication skills and the ability to work collaboratively with senior team members.
• Willingness to learn new technologies and continuously improve existing processes.
• Able to manage competing priorities while maintaining a high standard of delivery.

Disclaimer
Notwithstanding any guidelines given to level of experience sought, we will consider candidates from outside this range if they can demonstrate the necessary competencies.
Square One embraces diversity and will treat everyone equally. Please see our website for our full diversity statement.