Senior Data Engineer: Financial Data Lake & GenAI Pipelines

Valantic; Lisboa; On-site; EUR 90,000 - 120,000; Full time

Benefits offered by this job

Flexible working hours

Benefits

Job summary

Valantic is seeking a Senior Data Engineer to design and evolve a modern data lake for a financial-services context. You will build end-to-end ETL/ELT pipelines, ingest diverse data, and ensure quality, security, and maintainability.

You will collaborate with engineers, architects, and business stakeholders across AWS/Azure environments. You will work hands-on with NiFi, Spark, Python, SQL, Kafka, PostgreSQL, MongoDB, Parquet, and REST APIs, delivering scalable data solutions and

Qualifications

• Degree in Computer Science, Business Informatics, Data Engineering, or a comparable qualification.
• 5+ years of practical experience in data engineering, software development, data integration, or data-platform development.
• Proven experience designing, implementing, testing, and operating production-grade ETL/ELT pipelines.
• Strong skills in Python and SQL, including writing maintainable, performant, and testable code.
• Hands-on experience with Apache Spark and PySpark, including distributed data processing.
• Solid experience with Apache NiFi for data ingestion, routing, and monitoring.
• Experience with Apache Kafka for event-driven or real-time data flows.
• Knowledge of PostgreSQL and MongoDB; Parquet and modern data formats.
• Cloud experience with AWS and/or Azure; security, storage, and compute services.
• Ability to translate complex data requirements into technical designs; strong stakeholder communication.
• Understanding of data quality, lineage, observability, and governance; GenAI usage in development.

Responsibilities

• Design, build-out, and evolve a modern data lake solution for a financial-services environment.
• Develop robust ETL/ELT pipelines for structured and unstructured data end-to-end.
• Implement data ingestion, transformation, validation, storage, and provisioning.
• Collaborate with business and IT stakeholders to structure requirements and data mappings.
• Apply consistent engineering, testing, and deployment standards; ensure data quality and security.

Skills

Python

SQL

Data modeling

Data governance

Data quality

ETL/ELT design

CI/CD

Git

Spark

NiFi

Kafka

Cloud (AWS/Azure)

REST APIs

Polaris

Team collaboration

GenAI usage

Education

Degree in Computer Science, Data Engineering, or related field

Tools

Apache NiFi

Apache Spark

Python

SQL

Kafka

PostgreSQL

MongoDB

Parquet

REST APIs

Polaris

AWS/Azure

Job description

Valantic is seeking a Senior Data Engineer to design and evolve a modern data lake for a financial-services context. You will build end-to-end ETL/ELT pipelines, ingest diverse data, and ensure quality, security, and maintainability.

You will collaborate with engineers, architects, and business stakeholders across AWS/Azure environments. You will work hands-on with NiFi, Spark, Python, SQL, Kafka, PostgreSQL, MongoDB, Parquet, and REST APIs, delivering scalable data solutions and