Senior Data Engineer

Prometeia; Bologna; In loco; EUR 50.000 - 70.000; Tempo pieno

Descrizione del lavoro

A technology solutions provider in Bologna is seeking a Senior Data Engineer to design and develop scalable data pipelines and cloud integrations. Ideal candidates have a degree in Computer Science or related fields, along with 1-2 years of experience, preferably in the financial or insurance sector. The role requires strong technical skills in Python, distributed computing, and familiarity with cloud environments.

Competenze

• 1-2 years of experience in designing and implementing high-scalability pipelines.
• Experience in the financial/insurance sector is preferred.
• Good knowledge of computational and statistical libraries and frameworks.

Mansioni

• Design and orchestration of scalable data pipelines.
• Refactor existing ETL processes to improve scalability.
• Integrate solutions into cloud environments.

Conoscenze

Knowledge of algorithms and data structures

Good knowledge of Python programming language

Experience in using code versioning systems (Git)

Good knowledge of distributed computing frameworks for Python

Aptitude for working in a flexible and dynamic team environment

Formazione

Bachelor’s or Master’s degree in Computer Engineering, Computer Science, Data Science or equivalent

Strumenti

Spark

Postgres

Docker

Kubernetes

Azure DevOps

Jenkins

Descrizione del lavoro

Prometeia is a European leader in Enterprise Risk Management and Wealth & Asset Management solutions. The Software House Line (SHL) supports the digital transformation of banks and insurance companies by developing products that analyze large and diverse data sets. The role is for a Senior Data Engineer to design, develop and maintain scalable analytical systems with a focus on data pipelines and cloud integration.

ROLE AND RESPONSIBILITIES:

• Design, development and orchestration of scalable data pipelines to support complex analytical use cases.
• Design of new ETL processes and refactoring of existing ones to increase scalability and reliability.
• Integration of the developed solution into native or hybrid cloud environments.
• Defining specifications and technology choices in collaboration with various team stakeholders.

REQUIREMENTS:

• Bachelor’s or Master’s degree in Computer Engineering, Computer Science, Data Science or equivalent
• At least 1-2 years of experience in companies, preferably in the financial/insurance sector and in the design and implementation of high-scalability pipelines to support advanced analytical use-cases.
• Excellent knowledge of algorithms and data structures.
• Good knowledge of distributed computing frameworks for Python (e.g. Spark, Dask).
• Good knowledge of Python programming language and computational and statistical libraries and frameworks (e.g.: pandas, numpy).
• Good knowledge of relational databases (e.g., Postgres) and/or NoSQL (MongoDB).
• Experience in using code versioning systems (Git).

PREFERRED SKILLS:

• Knowledge of Data Science and Machine Learning libraries and frameworks (e.g., PyTorch, scikit-learn).
• Knowledge of PaaS and SaaS solutions offered by cloud providers (Azure, AWS, GCP).
• Familiarity with Data Governance techniques, technologies and tools.
• Aptitude for design and development of maintainable, robust, and scalable code including skillful use of design patterns.
• Knowledge of containerization technologies (Docker).
• Knowledge of application deployment and orchestration systems (Kubernetes).
• Knowledge of CI/CD systems (Jenkins, Azure DevOps, Github Actions).
• Ability to operate autonomously on Linux based systems.
• Knowledge of workflow management systems (e.g., Dagster, Apache Airflow, Luigi).

SOFT SKILLS:

• Aptitude for working in a flexible and dynamic team environment
• Problem-solving and relational skills
• Good knowledge of written and spoken English

LOCATION:

Bologna