Big Data Consultant

PrimeIT; Lisboa; Híbrido; EUR 13 000 - 22 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Food Allowance

Flex Benefits

Resumo da oferta

PrimeIT is seeking a Junior Big Data Engineer to join a Lisbon-based hybrid team. The role focuses on collecting, ingesting, cleansing, and preparing data using DATAIKU DSS, along with PySpark, Hive, and Hadoop.

You will consolidate data within a rigorous analytics framework and contribute to stress test modelling concepts daily. The ideal candidate will have hands-on experience with data processing tools, strong SQL and Python skills, and the ability to work in English.

Qualificações

• Data collection, data ingestion, data quality, and data preparation and cleaning using DATAIKU DSS.
• Experience with PySpark, Hive, and Hadoop in data processing pipelines.
• Proficiency in building robust data consolidation within a controlled analytical framework.

Responsabilidades

• Data collection, ingestion, quality, preparation, and cleaning using DATAIKU DSS with PySpark, Hive and Hadoop.
• Consolidate data within a strong control and analyses framework.
• Contribute to daily tasks involving credit data content and stress test modelling concepts.
• Develop, maintain and test processes to build quarterly databases.

Conhecimentos

Python

SQL

PySpark

Hive

Hadoop

Dataiku

Ferramentas

Python

SQL

PySpark

Hive

Hadoop

Dataiku

Descrição da oferta de emprego

PrimeIT is a leading company with over 19 years of experience in providing IT, Telecommunications, and Engineering technological services. Specialized in Team Extension, Managed Services, Custom Software, and Nearshore, we currently have a team of over 2350 professionals collaborating on national and international projects across various technologies.

We are looking for a Junior Big Data Engineer for this project! What are we looking for?

Main Tasks:

• Data collection, Data ingestion, Data quality, Data preparation, Data cleaning with DATAIKU DSS (Data Science Studio), using PySpark, Hive, Hadoop
• Data consolidation in a strong control and analyses framework
• Strong understanding of the credit data functional content and of stress tests modelling concepts are part of daily tasks
• Eevelopment, maintenance and testing of the process, to build quarterly databases

Technical Skills:

• Python
• SQL
• PySpark
• Hive
• Hadoop
• Dataiku (plus)

Location: Hybrid in Lisbon (Portugal)

Language: English is mandatory

Salary Package & Benefits: €1,200 to €2,000 (salary base) + Food Allowance + Flex Benefits

• Discover the 10 benefits of being a Primer https://www.youtube.com/watch?v=NQ0s0kLzZ0w and see why we are much more than just a technology company.