Big Data Engineer: Spark, Hadoop, Hive — Remote

KCS iT; Lisboa; Híbrido; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

KCS IT, based in Lisbon, is seeking an Amazing: Big Data Engineer with 4+ years of experience to design, develop and maintain scalable data platforms for processing large volumes of data. The role involves collaborating with data scientists, analysts and engineers across diverse projects.

You will work with PySpark, Apache Spark, Hadoop ecosystems and Hive, building robust data pipelines, models and ETL/ELT processes to support analytics and reporting needs. Hybrid/remote options are available.

Qualificações

Responsabilidades

• Design and maintain scalable Big Data solutions.
• Develop and optimize batch data pipelines with PySpark.
• Implement data solutions in Hadoop ecosystems for performance and reliability.
• Create data models and ETL/ELT processes for analytics.
• Use Hive for warehousing and large-scale queries.
• Collaborate with data scientists and engineers to deliver end-to-end solutions.
• Ensure data quality, governance, security and compliance.
• Document technical solutions and support operations.

Conhecimentos

PySpark

Apache Spark

Hadoop ecosystems

Hive

ETL/ELT

Data modeling

Data pipelines

Data governance

Data quality

Cloud data platforms

Documentation

Descrição da oferta de emprego

KCS IT, based in Lisbon, is seeking an Amazing: Big Data Engineer with 4+ years of experience to design, develop and maintain scalable data platforms for processing large volumes of data. The role involves collaborating with data scientists, analysts and engineers across diverse projects.

You will work with PySpark, Apache Spark, Hadoop ecosystems and Hive, building robust data pipelines, models and ETL/ELT processes to support analytics and reporting needs. Hybrid/remote options are available.