Apache Nifi Data Engineer

Consort Group; Lisboa; On-site; EUR 38,000 - 52,000; Full time

Job summary

Consort Group in Lisbon is seeking an Apache NiFi Data Engineer to design, build, and maintain high-performance data pipelines supporting financial and risk reporting. You will implement NiFi-driven ETL/ELT processes and collaborate with BI teams to ensure data quality.

Require 5–7 years in data engineering, with SQL, Python/PySpark, and experience in data warehousing. The role emphasizes CI/CD, stakeholder collaboration, and ongoing pipeline optimization.

Qualifications

• 5 to 7 years of professional experience in data engineering.
• Strong expertise in data integration and end-to-end pipeline development.
• Experience with BI platforms and data quality best practices.

Responsibilities

• Design and develop high-performance ETL/ELT data pipelines to feed data warehouses.
• Implement and optimize data integration workflows using Apache NiFi and other relevant technologies.
• Develop data processing solutions using SQL, Python, and/or PySpark.
• Design data models and schemas in line with business requirements and BI best practices.
• Implement CI/CD pipelines to automate workflows and manage end-to-end releases across environments.
• Collaborate with business stakeholders to translate functional requirements into technical solutions.
• Maintain and evolve existing data pipelines and integration processes.
• Support end-users in using Dataiku and applying data-related best practices.
• Troubleshoot data processing issues and contribute to the continuous improvement of data workflows.
• Ensure data quality, consistency, and reliability across reporting solutions.

Skills

Apache NiFi

SQL

Python/PySpark

ETL/ELT

Data modeling

CI/CD pipelines

BI analysis

Data governance

Tools

Alteryx

Talend

Dataiku

Jira

Power BI

Tableau

SAS

Job description

Every moment counts. Especially those you live to the fullest. Welcome to Consort Group.

For over 30 years, Consort Group has been helping companies leverage their data and infrastructure. It is backed by two leaders, Consortis and Consortia, and places people and social responsibility at the heart of its values.

This is your future team

Established in 2021, Consort Portugal supports the strategic offshoring choices of our clients, particularly in Europe, and brings our expertise in infrastructure services to the Portuguese market. With a team of around 45 employees, our Service Center based in Porto is developing a dynamic nearshore business, offering the French and European markets an environment of excellence and high potential.

This is your mission

Are you passionate about data engineering, automated data pipelines, and transforming complex data into reliable business insights? Then this position is for you.

As an Apache NiFi Data Engineer, you will contribute to the design, development, and maintenance of high-performance data pipelines supporting financial and risk reporting solutions. You will work with data integration technologies, modern engineering practices, and business intelligence platforms to ensure data quality, reliability, and efficient data processing.

Build side:

• Design and develop high-performance ETL/ELT data pipelines to feed data warehouses.
• Implement and optimize data integration workflows using Apache NiFi and other relevant technologies.
• Develop data processing solutions using SQL, Python, and/or PySpark.
• Design data models and schemas in line with business requirements and BI best practices.
• Implement CI/CD pipelines to automate workflows and manage end-to-end releases across environments.
• Contribute to the architecture and technical design of data integration solutions.
• Apply data engineering best practices to improve performance, reliability, and maintainability.
• Collaborate with business stakeholders to translate functional requirements into technical solutions.
• Maintain and evolve existing data pipelines and integration processes.
• Support end-users in using Dataiku and applying data-related best practices.
• Troubleshoot data processing issues and contribute to the continuous improvement of data workflows.
• Ensure data quality, consistency, and reliability across reporting solutions.
• Provide technical guidance and coaching to junior team members and stakeholders.
• Collaborate with multidisciplinary teams to ensure smooth delivery and ongoing support.

This is your background

You have 5 to 7 years of professional experience in data engineering, with solid expertise in data integration, ETL/ELT processes, and data pipeline development. You enjoy working with complex datasets, optimizing data workflows, and building reliable solutions that support business intelligence and risk reporting.

You are comfortable working in a demanding, collaborative environment, sharing your knowledge with others, and translating business needs into efficient technical solutions.

This is your expertise:

• Strong experience with Apache NiFi for data flow design and orchestration.
• Proficiency in SQL and Python and/or PySpark.
• Solid understanding of ETL/ELT processes and data integration techniques.
• Experience with data warehouse environments and data modelling.
• Knowledge of ETL tools such as Alteryx or Talend.
• Experience with CI/CD pipelines and automated deployment across environments.
• Familiarity with business intelligence and data analytics tools such as Dataiku, SAS, Power BI, or Tableau is a plus.
• Knowledge of Agile methodologies and Jira is a plus.
• Understanding of data quality, performance optimization, and BI best practices.

This is how you work as part of a team:

• Strong teamwork and collaboration skills.
• Client-focused mindset and ability to understand end-user needs.
• Excellent attention to detail and commitment to data quality.
• Strong written and verbal communication skills.
• Ability to present complex information clearly to different stakeholders.
• Proactive approach to problem-solving and continuous improvement.
• Ability to adapt to a fast-changing, demanding environment and manage multiple priorities.
• Willingness to coach colleagues and share technical knowledge.

Language Skills :

French: A2

Portuguese: A2

This is our commitment

At Consort Group, you are an expert who we support so that every assignment becomes a step that counts.

Attentive and human onboarding

A truly hands-on management style

Concrete commitments: inclusion, equality, solidarity

A culture of feedback and meaningful projects

The recruitment process:

An initial phone call with our recruitment team

An HR interview and a job interview with a business engineer

A test or technical interview with one of our experts

A final meeting with your future manager or project manager

And if we're a good fit, we'll get started together

Good to know

Location: Lisbon

Contract: Permanent contract

Salary: From 38 K€ to 52 K€ (depending on experience) gross annual salary

What you will do here, you won't do anywhere else.