Data Engineer – Middle/Senior

Findmore Consulting, S.A.; Lisboa; Presencial; EUR 55 000 - 75 000; Tempo integral

Resumo da oferta

Findmore Consulting S.A. is seeking a skilled Data Engineer to join our Portugal team.

You will design and implement Azure-based data solutions, build scalable ETL/ELT pipelines and collaborate with business and technical stakeholders to translate requirements into actionable technical specifications. The ideal candidate has 5+ years in data engineering, deep Azure Databricks and Data Lake experience, and a focus on data quality, security and governance.

Qualificações

• Minimum 5 years of professional experience in Data Engineering.
• Strong experience with the Microsoft Azure ecosystem, particularly Azure Databricks.
• Experience with distributed data storage technologies, especially Azure Data Lake Storage.
• Strong knowledge of data formats such as Parquet and Delta Lake.
• Experience across the full data solution lifecycle, including data ingestion, transformation, modelling and delivery.
• Proven ability to design scalable and performance-oriented data architectures.
• Experience working with Agile methodologies, particularly Scrum.
• Experience with Azure Data Factory.
• Knowledge of Scala to PySpark migration.
• Knowledge of Azure Synapse.
• Experience with Jira and Confluence.

Responsabilidades

• Collaborate with business and technical teams to gather, analyze and interpret data requirements
• Translate functional requirements into clear and actionable technical specifications
• Design, implement and optimize DataHub solutions within Microsoft Azure environments
• Develop efficient and scalable ETL/ELT pipelines using Azure Databricks, Azure Data Factory and/or PySpark notebooks
• Design and implement data models and end-to-end data solutions covering ingestion, transformation, modelling and data delivery
• Collaborate with technical teams on data architecture, standards and engineering best practices
• Ensure data quality, security and governance throughout the data solution lifecycle
• Provide technical guidance and support to junior team members, promoting data engineering best practices

Conhecimentos

Analytical thinking

Problem solving

Critical thinking

Scrum

Ferramentas

Azure Databricks

Azure Data Factory

PySpark

Azure Data Lake Storage

Parquet

Delta Lake

Azure Synapse

Jira & Confluence

Descrição da oferta de emprego

Findmore Consulting S.A. is a company specialized in Information Technologies founded in 2006 and with more than 400 consultants.

Our services include infrastructure and cloud, software development and agility where contribute to major projects in Portugal and Europe.We're looking for talented, purpose-driven people to join our teams!

Main Tasks & Responsibilities:

• Collaborate with business and technical teams to gather, analyze and interpret data requirements


• Translate functional requirements into clear and actionable technical specifications


• Design, implement and optimize DataHub solutions within Microsoft Azure environments


• Develop efficient and scalable ETL/ELT pipelines using Azure Databricks, Azure Data Factory and/or PySpark notebooks


• Design and implement data models and end-to-end data solutions covering ingestion, transformation, modelling and data delivery


• Collaborate with technical teams on data architecture, standards and engineering best practices


• Ensure data quality, security and governance throughout the data solution lifecycle


• Provide technical guidance and support to junior team members, promoting data engineering best practices

Requirements:

• Minimum 5 years of professional experience in Data Engineering


• Strong experience with the Microsoft Azure ecosystem, particularly Azure Databricks


• Experience with distributed data storage technologies, especially Azure Data Lake Storage


• Strong knowledge of data formats such as Parquet and Delta Lake


• Experience across the full data solution lifecycle, including data ingestion, transformation, modelling and delivery


• Proven ability to design scalable and performance-oriented data architectures


• Experience working with Agile methodologies, particularly Scrum


• Strong analytical, problem-solving and critical-thinking skills

Nice to Have:

• Experience with Azure Data Factory


• Knowledge of Scala to PySpark migration


• Knowledge of Azure Synapse


• Experience with Jira and Confluence

Other Requirements:

• Fluent in English


• Ability to simplify complex problems and obtain a workable solution;


• Customer focus and service delivery;


• Availability to work in EU.

More information on our website: https://www.findmore.pt/careers/#jobs