Data Engineer: Scalable Pipelines & Data Quality

Talent Search Technology; Barcelona; Presencial; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

Talent Search Technology is seeking a Data Engineer to build and maintain scalable data pipelines that support CRM operations, data matching and reporting. You will work with Full Stack Engineers and internal data teams to deliver reliable data solutions.

You will design ingestion and transformation workflows, implement data quality checks and ensure secure, scalable data architectures with near-real-time processing as a plus.

Formación

• Experience with AWS services (S3, RDS/PostgreSQL, IAM, EMR, Glue, Athena, Redshift).
• Strong Spark experience for data transformations and batch processing.
• Expertise in ETL/ELT, data modeling, schema design, data quality and lineage.
• Advanced SQL and performance tuning.
• Experience with Git, CI/CD, data testing, monitoring and production support.
• Understanding of data security, encryption and secrets management.
• History building scalable, reliable data pipelines; near-real-time processing a plus.

Responsabilidades

• Design and maintain data ingestion, transformation and publishing pipelines.
• Analyze source systems and define data contracts and integration needs.
• Develop data models for customer profiles, opportunities, matching and reporting.
• Implement data quality checks, reconciliation, error handling and tracing.
• Optimize workloads for performance, scalability and cost.
• Collaborate with Full Stack teams for data consumption.
• Maintain data lineage documentation and recovery procedures.

Conocimientos

AWS

Apache Spark

SQL

ETL/ELT

Data modeling

Git

CI/CD

Data security

Data pipelines

Near-real-time processing

Herramientas

Git

CI/CD

Monitoring

Descripción del empleo

Talent Search Technology is seeking a Data Engineer to build and maintain scalable data pipelines that support CRM operations, data matching and reporting. You will work with Full Stack Engineers and internal data teams to deliver reliable data solutions.

You will design ingestion and transformation workflows, implement data quality checks and ensure secure, scalable data architectures with near-real-time processing as a plus.