Big Data Consultant

PrimeIT; Lisboa; Hybride; EUR 13 000 - 22 000; Plein temps

Avantages offerts par ce poste

Food Allowance

Flexible Benefits

Résumé du poste

PrimeIT in Lisbon is seeking a Junior Big Data Engineer to join our project teams. You will handle data collection, ingestion, and quality tasks using Dataiku DSS, PySpark, Hive, and Hadoop, contributing to robust data pipelines.

You will work in a hybrid Lisbon setup, with English as a required language, and enjoy a competitive salary package plus food allowance and flex benefits.

Qualifications

• Experience with data collection, ingestion, and quality processes.
• Familiar with credit data concepts and stress test modelling.
• Able to build and test quarterly data databases.

Responsabilités

• Collect, ingest, and clean data using PySpark, Hive, Hadoop.
• Consolidate data within a strong control framework.
• Develop, maintain, and test ETL processes to build quarterly databases.

Connaissances

Python

SQL

PySpark

Hive

Hadoop

Outils

Dataiku

Description du poste

PrimeIT is a leading company with over 19 years of experience in providing IT, Telecommunications, and Engineering technological services. Specialized in Team Extension, Managed Services, Custom Software, and Nearshore, we currently have a team of over 2350 professionals collaborating on national and international projects across various technologies.

We are looking for a Junior Big Data Engineer for this project!

What are we looking for?

• Data collection, Data ingestion, Data quality, Data preparation, Data cleaning with DATAIKU DSS (Data Science Studio), using PySpark, Hive, Hadoop
• Data consolidation in a strong control and analyses framework
• Strong understanding of the credit data functional content and of stress tests modelling concepts are part of daily tasks
• Eevelopment, maintenance and testing of the process, to build quarterly databases

Technical Skills:

• Python
• SQL
• PySpark
• Hive
• Hadoop
• Dataiku (plus)

Location:

Hybrid in Lisbon (Portugal)

Language:

English is mandatory

Salary Package & Benefits: €1,200 to €2,000 (salary base) + Food Allowance + Flex Benefits

• Discover the 10 benefits of being a Primer https://www.youtube.com/watch?v=NQ0s0kLzZ0w and see why we are much more than just a technology company.