Data Engineer

Talent Search Technology; Barcelona; Presencial; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

Talent Search Technology is seeking a Data Engineer to build and maintain scalable data pipelines that support CRM operations, data matching and reporting. You will work with Full Stack Engineers and internal data teams to deliver reliable data solutions.

You will design ingestion and transformation workflows, implement data quality checks and ensure secure, scalable data architectures with near-real-time processing as a plus.

Formación

• Experience with AWS services (S3, RDS/PostgreSQL, IAM, EMR, Glue, Athena, Redshift).
• Strong Spark experience for data transformations and batch processing.
• Expertise in ETL/ELT, data modeling, schema design, data quality and lineage.
• Advanced SQL and performance tuning.
• Experience with Git, CI/CD, data testing, monitoring and production support.
• Understanding of data security, encryption and secrets management.
• History building scalable, reliable data pipelines; near-real-time processing a plus.

Responsabilidades

• Design and maintain data ingestion, transformation and publishing pipelines.
• Analyze source systems and define data contracts and integration needs.
• Develop data models for customer profiles, opportunities, matching and reporting.
• Implement data quality checks, reconciliation, error handling and tracing.
• Optimize workloads for performance, scalability and cost.
• Collaborate with Full Stack teams for data consumption.
• Maintain data lineage documentation and recovery procedures.

Conocimientos

AWS

Apache Spark

SQL

ETL/ELT

Data modeling

Git

CI/CD

Data security

Data pipelines

Near-real-time processing

Herramientas

Git

CI/CD

Monitoring

Descripción del empleo

We are looking for a Data Engineer to build and maintain scalable data pipelines and integrations supporting CRM operations, data matching, and reporting. You’ll work closely with Full Stack Engineers and internal data teams.

Key Requirements

• Strong hands-on experience with AWS: S3, RDS/PostgreSQL, IAM, EMR, Glue, Athena, and Redshift.
• Strong Apache Spark experience for transformations, joins, calculations, and batch processing.
• Solid expertise in ETL/ELT, data modeling, schema design, data quality, reconciliation, metadata, and data lineage.
• Advanced SQL skills, including complex transformations, validation, and performance optimization.
• Experience with Git, CI/CD, automated data testing, parameterization, monitoring, logging, and production support.
• Strong understanding of data security, including IAM, least privilege, encryption, and secrets management.
• Experience building scalable, reliable, and production-ready data pipelines.
• Exposure to near-real-time processing is a plus.

What You’ll Do

• Design and maintain data ingestion, transformation, and publishing pipelines.
• Analyze source systems and define data contracts and integration requirements.
• Develop data models for customer profiles, opportunities, matching, tracking, and reporting.
• Implement data quality checks, reconciliation, error handling, monitoring, and traceability.
• Optimize data workloads for performance, scalability, and cost efficiency.
• Partner with Full Stack teams to enable effective application data consumption.
• Maintain documentation for data lineage, dependencies, business rules, and recovery procedures.