Lisbon NiFi Data Engineer — High-Impact ETL Pipelines

Consort Group; Lisboa; Presencial; EUR 38.000 - 52.000; Jornada completa

Descripción de la vacante

Consort Group in Lisbon is seeking an Apache NiFi Data Engineer to design, build, and maintain high-performance data pipelines supporting financial and risk reporting. You will implement NiFi-driven ETL/ELT processes and collaborate with BI teams to ensure data quality.

Require 5–7 years in data engineering, with SQL, Python/PySpark, and experience in data warehousing. The role emphasizes CI/CD, stakeholder collaboration, and ongoing pipeline optimization.

Formación

• 5 to 7 years of professional experience in data engineering.
• Strong expertise in data integration and end-to-end pipeline development.
• Experience with BI platforms and data quality best practices.

Responsabilidades

• Design and develop high-performance ETL/ELT data pipelines to feed data warehouses.
• Implement and optimize data integration workflows using Apache NiFi and other relevant technologies.
• Develop data processing solutions using SQL, Python, and/or PySpark.
• Design data models and schemas in line with business requirements and BI best practices.
• Implement CI/CD pipelines to automate workflows and manage end-to-end releases across environments.
• Collaborate with business stakeholders to translate functional requirements into technical solutions.
• Maintain and evolve existing data pipelines and integration processes.
• Support end-users in using Dataiku and applying data-related best practices.
• Troubleshoot data processing issues and contribute to the continuous improvement of data workflows.
• Ensure data quality, consistency, and reliability across reporting solutions.

Conocimientos

Apache NiFi

SQL

Python/PySpark

ETL/ELT

Data modeling

CI/CD pipelines

BI analysis

Data governance

Herramientas

Alteryx

Talend

Dataiku

Jira

Power BI

Tableau

SAS

Descripción del empleo

Consort Group in Lisbon is seeking an Apache NiFi Data Engineer to design, build, and maintain high-performance data pipelines supporting financial and risk reporting. You will implement NiFi-driven ETL/ELT processes and collaborate with BI teams to ensure data quality.

Require 5–7 years in data engineering, with SQL, Python/PySpark, and experience in data warehousing. The role emphasizes CI/CD, stakeholder collaboration, and ongoing pipeline optimization.