Lead Data Engineer

Intellias; Madrid; A distancia; EUR 60.000 - 80.000; Jornada completa

Descripción de la vacante

A leading tech company is looking for a Lead Data Engineer to lead a data engineering team focused on modernizing enterprise-scale capabilities. The ideal candidate has 5+ years of experience in data engineering with expertise in Python and SQL, and 3+ years in AWS. The role involves designing ETL processes and ensuring data integrity, while mentoring team members and aligning strategies with business objectives. This position is remote from Spain.

Formación

• 5+ years of hands-on experience in data engineering with Python and SQL.
• 3+ years of experience with AWS (Glue, S3, Athena, Lambda, Data Zone).
• Strong experience with Airflow and Spark.

Responsabilidades

• Lead a data engineering team.
• Collaborate with business stakeholders and technical teams to understand and analyze data requirements.
• Lead the design and implementation of data models and database structures.

Conocimientos

Data engineering

Python

SQL

AWS (Glue, S3, Athena, Lambda, Data Zone)

Airflow

Spark

Code versioning (git)

CI/CD pipelines

Descripción del empleo

Lead Data Engineer

Location: Remote from Spain

Join a transformative data and AI platform initiative aimed at modernizing enterprise-scale capabilities and enabling real-time decision-making. This project delivers a comprehensive roadmap covering AI, MLOps, data governance, and platform scalability, supporting a shift towards data-first operations and intelligent automation.

Requirements:

• 5+ years of hands-on experience in data engineering with Python and SQL.
• 3+ years of experience with AWS (Glue, S3, Athena, Lambda, Data Zone).
• Strong experience with Airflow and Spark.
• Drive the design and implementation of data warehouses and data lakes.
• Proficient in code versioning (git) and building CI/CD pipelines for data projects.
• Experience with requirement gathering and documentation.

Will be a plus:

• Experience with NoSQL.

Responsibilities:

• Lead a data engineering team.
• Collaborate with business stakeholders and technical teams to understand and analyze data requirements.
• Lead the design and implementation of data models and database structures that meet business needs.
• Profile, refactor, and tune database performance.
• Design and implement complex ETL processes to extract, transform, and load data from various source systems into the data warehouse.
• Ensure data integrity, consistency, and accuracy through robust data quality assurance measures.
• Review and support team members, providing guidance and mentorship.
• Supervise and contribute to the data-driven strategy for the project, aligning it with business objectives.