Senior Developer / Data Engineer

Caixa Mágica Software; Lisboa; Presencial; EUR 40 000 - 64 000; Tempo integral

Resumo da oferta

Caixa Mágica Software is seeking a skilled Developer to work on evolving third-party data ecosystems. You will streamline data integration, enable real-time accessibility, and ensure high data quality across referentials while reducing discrepancies in reporting.

You will develop the technical solution framework, implement unit tests, and industrialize CI/CD practices. Collaboration with end-users and a focus on data exposure will be key to success.

Qualificações

• Proficiency in Python with data engineering libraries.
• Dataiku is mandatory.
• Cloud experience (AWS, IBM) and Docker.
• Exposure to ETL processes and data virtualization.
• Strong SQL knowledge and databases.

Responsabilidades

• Develop the technical solution framework and participate in TPCV modeling
• Develop the TPCV and implement unit tests
• Industrialize the solution according to CI/CD best practices
• Participate in the validation phase with end-users
• Implement the data exposure solution

Conhecimentos

Python

CI/CD

Unit testing

Versioning

Agile

SQL

Communication

Teamwork

French basics

Ferramentas

Pandas

Polars

SQLAlchemy

Psycopg2

IBM boto3

Docker

AWS

Dataiku

Jira

Confluence

ALM

PostgreSQL

Oracle

Descrição da oferta de emprego

Overview:

The Developer will work on a project focused on the evolution of third-party data ecosystems would aim to streamline the integration of new data and technologies such as data virtualization, APIs, etc., enhancing the accessibility and real-time availability of data across systems.
They would ensure high data quality and consistency across various referentials ata sources and reducing discrepancies in reporting and closing figures by performing a deep analyses on the existing data and sources and transform the processes and technologies used, including the existing referentials. The goal is to streamline workflows, improving time to market and enabling faster and more accurate insights for better decision-making.

What will you do?

• Develop the technical solution framework and participate in TPCV modeling
• Develop the TPCV and implement unit tests
• Industrialize the solution according to CI/CD best practices
• Participate in the validation phase with end-users
• Implement the data exposure solution

What are we looking for?

• Proficiency in Python programming language and libraries such as Pandas, Polars, SQLAlchemy, Psycopg2, ibmboto3, etc)
• Mastery of good programming practices (CI/CD, unit testing, versioning, etc.) and Dataiku (mandatory)
• Experience with cloud environments (AWS, IBM, etc.) and containerization using Docker
• Agile Methodologies and tools (Jira, Confluence, ALM)
• Knowledge of ETL (Extract, Transform, Load) processes and best practices/optimizations
• Strong understanding of SQL and one or more databases (PostgreSQL, Oracle, etc.)
• French Notions
• Business/IT relationship
• Good oral and written communication skills
• Creativity & Innovation / Problem solving
• Ability to understand functional requests from end users, explain and support change
• Ability to collaborate / Teamwork

What can you expect from us?

• A permanent job contract for a long term project;
• Tech equipment + SIM Card + personal smartphone;
• Health and Life Insurance;
• Social events and team buildings;
• The commitment of letting you grow with us, and be rewarded accordingly;
• A dynamic and young team that will be always there to support you;
• Training in the latest technologies;
• Coffee, fruits, snacks and a warm welcoming when you pass by the office.