Cloud data engineer

Fyld; Lisboa; Hybrid; EUR 70.000 - 100.000; Vollzeit

Zusammenfassung

Fyld в Португалии ищет старшего инженера по данным с сильным фокусом на управление данными для разработки и эволюции корпоративной облачной платформы. Вы будете работать над архитектурами данных, сбором требований и сотрудничать с командами.

Кандидат должен иметь опыт разработки конвейеров данных в облаке (Azure), владение Azure Data Factory, Data Lake Gen2 и Databricks, знание Data Governance, качества данных и безопасности. Гибридная работа: 2 дня в офисе в Лиссабоне.

Qualifikationen

• Требуется опыт разработки и поддержки облачных дата‑платформ и конвейеров данных.
• Опыт работы с Azure Data Factory, Azure Data Lake Storage Gen2 и Databricks.
• Знание концепций Data Governance: каталогизация данных, управление метаданными и отслеживаемость.
• Умение обеспечивать качество данных, безопасность и соблюдение требований.
• Свободное владение английским языком, письменная и устная коммуникация.

Aufgaben

• Проектирование, разработка и эволюция облачных дата‑платформ (Data Lakes, Lakehouses, Data Warehouses).
• Построение, поддержка и оптимизация ETL/ELT конвейеров для надежной обработки данных.
• Внедрение и сопровождение практик управления данными: каталогизация, метаданные, линейка данных, качество и доступ.
• Обеспечение качества, согласованности, безопасности и соответствия по жизненному циклу данных.
• Совмещение с командами данных, аналитики, BI и бизнеса для доставки доверенных данных.

Kenntnisse

Data governance

SQL

ETL/ELT

Data modelling

Cloud data platforms

Analytical thinking

English proficiency

Ausbildung

Degree in Computer Science or related field

Tools

Azure Data Factory

Azure Data Lake Storage Gen2

Databricks

Jobbeschreibung

Описание:

Fyld is a Portuguese consulting company specializing in IT services. We bring high-performance professionals into the field across various technological areas. Inspired by sports management philosophy, we strive to achieve peak performance with each of our consultants. We focus on training and excellence. We are looking for a Senior Data Engineer with a strong focus on Data Governance to join a team responsible for the design, development and evolution of a corporate cloud data platform.

Задачи:

Designing, developing and evolving cloud-based data platforms, including Data Lakes, Lakehouses and Data Warehouses. Building, maintaining and optimising ETL/ELT pipelines to ensure reliable and efficient data ingestion, transformation and processing. Implementing and maintaining data governance practices, including data cataloguing, metadata management, data lineage and data traceability. Ensuring data quality, consistency, security and compliance throughout the data lifecycle. Implementing data access controls, governance policies and monitoring mechanisms to support secure and responsible data usage. Developing and maintaining scalable data architectures to support business intelligence, analytics and data science initiatives. Working with data modelling techniques and defining data structures that meet business and analytical requirements. Automating data workflows and implementing monitoring, observability and data quality controls. Identifying and resolving data pipeline issues, investigating root causes and implementing performance improvements. Collaborating with Data, Analytics, BI, Data Science and business teams to understand requirements and deliver trusted, high-quality data. Contributing to the continuous improvement of data engineering practices, cloud platform capabilities and governance standards.

Требования:

Degree in Computer Science, Information Technology, Data Engineering or a related field. Strong professional experience in Data Engineering, particularly in the development and maintenance of data pipelines and cloud data platforms. Experience with cloud technologies, with a strong preference for Microsoft Azure. Hands-on experience with Azure data services, particularly Azure Data Factory, Azure Data Lake Storage Gen2 and Databricks. Solid knowledge of SQL, data transformation and ETL/ELT processes. Experience with data modelling and modern data architectures, including Data Lakes, Lakehouses and Data Warehouses. Knowledge of Data Governance concepts, including data cataloguing, metadata management, data lineage, data quality and access control. Experience implementing data quality checks, monitoring mechanisms and data security practices. Understanding of data lifecycle management and the importance of data traceability, reliability and consistency. Strong analytical and problem-solving skills, with the ability to troubleshoot complex data issues. Good communication and interpersonal skills, with the ability to collaborate with technical teams and business stakeholders. A proactive mindset, attention to detail and a strong interest in continuous improvement. Fluency in English, both written and spoken. Будет плюсом: Experience working with Google Cloud Platform (GCP) is also valued, particularly in cloud-based data engineering environments; Microsoft Azure certifications are highly valued, especially those related to data engineering, analytics and cloud data platforms. Relevant GCP certifications are also a plus

Условия:

Hybrid – 2 days per week onsite in Lisbon.