Senior Data Engineer

Jobtailor; Lisboa; Presencial; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Jobtailor is seeking a data engineering professional to lead end-to-end delivery of projects, representing the team in large initiatives and coaching junior members. The role focuses on building scalable data pipelines, maintaining existing processes, and communicating outcomes to stakeholders.

The ideal candidate will have hands-on experience with Azure Data Lake, Data Factory, Databricks, EventHub, and SSIS, and will thrive in a fast-paced environment with a strong preference for autonomy and

Qualificações

• Experience with Azure Data Lake, Data Factory, Databricks, EventHub, SSIS and relational databases.
• Build data analytical platforms to deliver business value.
• Understand different data types and storage considerations.
• Contribute to all aspects of technical solutions – design, infrastructure, development, testing and maintenance.
• Track record of initiative and delivering end-to-end projects with autonomy.
• Perform root cause analysis on internal/external data to answer business questions and fix issues.
• Communicate with all levels, lead meetings, and negotiate deliveries and deadlines.
• Curiosity, energy and willingness to go the extra mile.

Responsabilidades

• Represent the team in projects and deliver them end-to-end.
• Act as the single point of contact for the team in large projects.
• Review the work and coach junior team members, including embedded peer review process.
• Design and build data pipelines to collect data from different sources for different purposes and types of consumption across the whole data engineering life cycle.
• Maintaining the existing processes in place, monitoring batch failures, acting accordingly in identifying and resolving the root cause and communicate with stakeholders on resolution and timescales.

Conhecimentos

Data pipeline design

End-to-end project delivery

Stakeholder communication

Problem solving

Autonomy / self-driven

Continuous learning

Mentoring / coaching

Leadership in meetings

Ferramentas

Azure Data Lake Storage

Azure Data Factory

Databricks

EventHub

SSIS

Relational databases

Descrição da oferta de emprego

Responsibilities

• You will be responsible to represent the team in projects and deliver them end to end
• Act as the single point of contact for the team in large projects
• Review the work and coach junior team members, including embedded peer review process
• Design and build data pipelines to collect data from different sources for different purposes and types of consumption across the whole data engineering life cycle
• Maintaining the existing processes in place, monitoring batch failures, acting accordingly in identifying and resolving the root cause and communicate with stakeholders on resolution and timescales

Requirements

• Experience working with Microsoft Azure Data Lake Storage, Microsoft Azure Data Factory, Databricks, EventHub, SSIS and relational databases
• Passion for and experience of building data analytical platforms to deliver business value
• Good understanding of different types of data (i.e. structured, semi-structured and unstructured data) and the considerations that should be made in how they are stored
• Ability to contribute to all aspects of technical solutions to business problems – design, infrastructure, development, testing and maintenance
• Track record of taking initiative and delivering projects end-to-end; clear evidence of being self-driven/ motivated, working autonomy
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions, identify the source of any data errors or performance issues, identify opportunities for improvement and solve and /or implement them
• The ability to communicate with all levels, and be confident enough to lead meetings, negotiate deliveries and deadlines and represent the team in projects
• Immense curiosity, high energy and desire to go the extra mile to make a difference