Apache NiFi data engineer for risk reporting

Consort Group; Lisboa; On-site; EUR 38,000 - 52,000; Full time

Benefits offered by this job

Health insurance

TR card

CSE

Job summary

Consort Portugal is seeking an experienced Data Engineer to join our nearshore Service Center in Porto. You will design and develop high-performance ETL/ELT pipelines feeding data warehouses, implement CI/CD for data workflows, and collaborate with stakeholders to translate requirements into scalable data solutions.

The ideal candidate has 5–7 years of data engineering experience, strong SQL Python skills, and hands-on experience with NiFi, data warehousing, and BI tools.

Qualifications

• 5 to 7 years of professional experience in data engineering.
• You enjoy working with complex datasets, optimizing data workflows, and building reliable solutions that support business intelligence and risk reporting.
• You are comfortable working in a demanding, collaborative environment, sharing your knowledge with others, and translating business needs into efficient technical solutions.
• Strong experience with Apache NiFi for data flow design and orchestration.
• Proficiency in SQL and Python and/or PySpark.
• Solid understanding of ETL/ELT processes and data integration techniques.
• Experience with data warehouse environments and data modelling.
• Experience with CI/CD pipelines and automated deployment across environments.
• Understanding of data quality, performance optimization, and BI best practices.
• Strong teamwork and collaboration skills.
• Client-focused mindset and ability to understand end-user needs.
• Excellent attention to detail and commitment to data quality.
• Strong written and verbal communication skills.
• Ability to present complex information clearly to different stakeholders.
• Proactive approach to problem-solving and continuous improvement.
• Ability to adapt to a fast-changing, demanding environment and manage multiple priorities.
• Willingness to coach colleagues and share technical knowledge.
• English: C1 French: A2 Portuguese: A2 Будет плюсом:

Responsibilities

• Design and develop high-performance ETL/ELT data pipelines to feed data warehouses.
• Implement and optimize data integration workflows using Apache NiFi and other relevant technologies.
• Develop data processing solutions using SQL, Python, and/or PySpark.
• Design data models and schemas in line with business requirements and BI best practices.
• Implement CI/CD pipelines to automate workflows and manage end-to-end releases across environments.
• Contribute to the architecture and technical design of data integration solutions.
• Apply data engineering best practices to improve performance, reliability, and maintainability.
• Collaborate with business stakeholders to translate functional requirements into technical solutions.
• Maintain and evolve existing data pipelines and integration processes.
• Support end-users in using Dataiku and applying data-related best practices.
• Troubleshoot data processing issues and contribute to the continuous improvement of data workflows.
• Ensure data quality, consistency, and reliability across reporting solutions.
• Provide technical guidance and coaching to junior team members and stakeholders.
• Collaborate with multidisciplinary teams to ensure smooth delivery and ongoing support.

Skills

ETL/ELT development

Data integration

SQL

Python

Apache NiFi

Data warehousing

BI reporting

Tools

Alteryx

Talend

Dataiku

SAS

Power BI

Tableau

Jira

Job description

Описание

For over 30 years, Consort Group has been helping companies leverage their data and infrastructure. It is backed by two leaders, Consortis and Consortia, and places people and social responsibility at the heart of its values. This is your future team Established in 2021, Consort Portugal supports the strategic offshoring choices of our clients, particularly in Europe, and brings our expertise in infrastructure services to the Portuguese market. With a team of around 45 employees, our Service Center based in Porto is developing a dynamic nearshore business, offering the French and European markets an environment of excellence and high potential.

Задачи

• Design and develop high-performance ETL/ELT data pipelines to feed data warehouses.
• Implement and optimize data integration workflows using Apache NiFi and other relevant technologies.
• Develop data processing solutions using SQL, Python, and/or PySpark.
• Design data models and schemas in line with business requirements and BI best practices.
• Implement CI/CD pipelines to automate workflows and manage end-to-end releases across environments.
• Contribute to the architecture and technical design of data integration solutions.
• Apply data engineering best practices to improve performance, reliability, and maintainability.
• Collaborate with business stakeholders to translate functional requirements into technical solutions.
• Maintain and evolve existing data pipelines and integration processes.
• Support end-users in using Dataiku and applying data-related best practices.
• Troubleshoot data processing issues and contribute to the continuous improvement of data workflows.
• Ensure data quality, consistency, and reliability across reporting solutions.
• Provide technical guidance and coaching to junior team members and stakeholders.
• Collaborate with multidisciplinary teams to ensure smooth delivery and ongoing support.

Требования

• 5 to 7 years of professional experience in data engineering, with solid expertise in data integration, ETL/ELT processes, and data pipeline development.
• You enjoy working with complex datasets, optimizing data workflows, and building reliable solutions that support business intelligence and risk reporting.
• You are comfortable working in a demanding, collaborative environment, sharing your knowledge with others, and translating business needs into efficient technical solutions.
• Strong experience with Apache NiFi for data flow design and orchestration.
• Proficiency in SQL and Python and/or PySpark.
• Solid understanding of ETL/ELT processes and data integration techniques.
• Experience with data warehouse environments and data modelling.
• Experience with CI/CD pipelines and automated deployment across environments.
• Understanding of data quality, performance optimization, and BI best practices.
• Strong teamwork and collaboration skills.
• Client-focused mindset and ability to understand end-user needs.
• Excellent attention to detail and commitment to data quality.
• Strong written and verbal communication skills.
• Ability to present complex information clearly to different stakeholders.
• Proactive approach to problem-solving and continuous improvement.
• Ability to adapt to a fast-changing, demanding environment and manage multiple priorities.
• Willingness to coach colleagues and share technical knowledge.
• English: C1 French: A2 Portuguese: A2 Будет плюсом:

• Knowledge of ETL tools such as Alteryx or Talend
• Familiarity with business intelligence and data analytics tools such as Dataiku, SAS, Power BI, or Tableau is a plus
• Knowledge of Agile methodologies and Jira is a plus

Условия

• Attentive and human onboarding
• A truly hands-on management style
• Continuous training opportunities
• Concrete commitments: inclusion, equality, solidarity
• A comprehensive HR package: health insurance, TR card, CSE
• A culture of feedback and meaningful projects
• Contract: Permanent contract
• Salary: From 38 K€ to 52 K€ (depending on experience) gross annual salary