Data Engineer (Cascais - Hybrid)

Claranet; Portugal; Hybride; EUR 42 000 - 62 000; Plein temps

Avantages offerts par ce poste

Dynamic team

Training opportunities

Career growth

Competitive salary

Résumé du poste

Claranet in Cascais is seeking a Data Engineer to join our Talent Team on a hybrid schedule. You will design and implement data pipelines, ensure data quality, and work with modern data architectures to enable analytics and decision making.

You'll develop data solutions using Python, Apache Spark, Airflow, and dbt, collaborate with business users, and contribute to data governance and cataloguing while embracing a dynamic, growth-oriented environment.

Qualifications

• Must have proven experience with Python.
• Experience with Apache Spark.
• Experience using Apache Airflow for workflow orchestration.
• Solid knowledge of dbt (Data Build Tool).
• Experience in data modelling and transformation.
• Knowledge of analytical data architectures and Data Warehousing.
• Experience implementing data quality and Data Governance processes.

Responsabilités

• Develop and implement data transformation rules to support analytics.
• Build and maintain end-to-end data pipelines for ingestion, transformation, and delivery.
• Work with data architectures, particularly the Medallion Architecture (Bronze, Silver, Gold).
• Develop data solutions using Python, Spark, Airflow, and dbt.
• Implement and monitor data integration across cloud and on-prem environments.
• Contribute to Data Governance initiatives, data cataloguing, and metadata management.
• Ensure data lineage and metadata management with tools like OpenMetadata.
• Collaborate with business and analytics teams to meet reporting needs.

Connaissances

Python

Apache Spark

Apache Airflow

dbt

Data modelling

Data warehousing

Data governance

Description du poste

Data Engineer (Cascais - Hybrid)

Empresa : Claranet Tipo de Emprego : Periodo Integral Portugal

Descrição do Emprego - Data Engineer (Cascais - Hybrid)

We're fast learners, hard workers, natural collaborators... and we Make Modern Happen!

Our ambition is to unlock the potential of our digital world so that organisations everywhere can innovate and thrive securely. We aim to achieve this goal by bringing together the world’s most talented people and the most powerful technologies, combining them to address our customers' challenges and build something stronger together.

If you share our vision, join us!

Right now, we are looking for a Data Engineer for a client on our Talent Team.

Your responsibilities include:

• Develop and implement data transformation rules, ensuring data quality, consistency, and reliability to support analytics and reporting.

• Build and maintain end-to-end data pipelines for data ingestion, transformation, and delivery to analytical consumers.

• Work with modern data architectures, particularly the Medallion Architecture (Bronze, Silver, and Gold layers).

• Develop data solutions using Python, Apache Spark, Apache Airflow, and dbt.

• Implement and monitor data integration, processing, and delivery processes across cloud and/or on-premises environments.

• Contribute to Data Governance initiatives, data cataloguing, and metadata management.

• Ensure data traceability through Data Lineage and Metadata Management tools, such as OpenMetadata.

• Collaborate with business and analytics teams to ensure that datasets meet functional requirements and reporting needs.

You must have:

• Proven experience with Python.

• Experience with Apache Spark.

• Experience using Apache Airflow for workflow orchestration.

• Solid knowledge of dbt (Data Build Tool).

• Experience in data modelling and transformation.

• Knowledge of analytical data architectures and Data Warehousing.

• Experience implementing data quality and Data Governance processes.

We offer:

• Integration into a dynamic and motivated team.

• Additional training and opportunities to develop your technical skills.

• A salary package aligned with the role.

• Professional development and career growth opportunities.

Workplace: Hybrid - Cascais (4 days per week at the office).

Claranet - Make Modern Happen!