Senior Data Architect: Big Data, Spark & Airflow

act digital; Lisboa; Presencial; EUR 60 000 - 90 000; Tempo parcial

Resumo da oferta

A prominent IT services company is seeking a Big Data Architect in Lisbon. The successful candidate will design scalable, resilient, and secure Big Data architectures while collaborating with various teams to ensure data availability. Required expertise includes strong experience with Apache Spark and Airflow, as well as knowledge of distributed systems and cloud platforms. This mid-senior level contract role offers opportunities for professional development in a dynamic consulting environment.

Qualificações

• Proven experience as a Big Data Architect or similar technical role.
• Strong expertise in Apache Spark and performance tuning.
• Solid hands-on experience with Apache Airflow for data workflows.

Responsabilidades

• Design and implement Big Data architectures.
• Develop and maintain data pipelines using Apache Airflow.
• Collaborate with teams to ensure data quality and governance.

Conhecimentos

Apache Spark (PySpark, SQL, performance tuning)

Apache Airflow (DAGs, operators, sensors)

Big Data technologies (Hadoop, Hive, Kafka, Delta Lake)

Cloud platforms (AWS, Azure, GCP)

Distributed systems and clustering

Descrição da oferta de emprego

A prominent IT services company is seeking a Big Data Architect in Lisbon. The successful candidate will design scalable, resilient, and secure Big Data architectures while collaborating with various teams to ensure data availability. Required expertise includes strong experience with Apache Spark and Airflow, as well as knowledge of distributed systems and cloud platforms. This mid-senior level contract role offers opportunities for professional development in a dynamic consulting environment.