Data Engineer

Avensys Consulting; Paris; Sur place; EUR 50 000 - 70 000; Plein temps

Résumé du poste

A leading consultancy firm in France is seeking a Senior Data Engineer/Data Analyst to manage applications related to the Chief Digital & Marketing Office. You will be responsible for developing and maintaining data pipelines, optimizing backend deployment on GCP, and automating AI workflows. The ideal candidate has strong Python skills and experience with BigQuery. Join a dynamic team that works on various innovative projects.

Qualifications

• Experience in developing and maintaining data pipelines.
• Proficiency with BigQuery and data sourcing.
• Strong Python programming skills and understanding of CI/CD methodologies.

Responsabilités

• Develop and maintain data pipelines for various applications.
• Perform data sourcing and ensure efficient data integration.
• Automate AI workflows and improve existing codebases.

Connaissances

Data pipelines development

BigQuery Datalake

Python coding

SQL queries

CI/CD pipeline optimization

Data documentation

AI workflow automation

Description du poste

Senior Data Engineer/Data Analyst profile to manage applications related to the CDMO (Chief Digital & Marketing Office) business, within a dynamic team with diverse roles (Tech Lead, Full Stack Developer, Data Scientist, Product Owner, QA, etc.).

One of the applications, One Creative, provides a comprehensive view of media asset performance and optimization—from global strategy down to local activation.

Mission Includes:

• Developing and maintaining data pipelines for:
• Data sourcing (BigQuery Datalake)
• Downloading video assets via social media platform APIs
• Creative analysis (internal Augmented DAM application)
• Automation of AI workflows (embedding, clustering)
• Transforming raw Datalake data into optimized tables for the One Creative application (merging performance KPIs, metadata, creative data, etc.)
• Optimizing backend deployment on GCP
• Improving the codebase by adding unit and integration tests to Python code
• Developing an initial monitoring layer for retrieved data (assets, KPIs)
• Modernizing technical components (thumbnails, product detection, encoder) with more modern and efficient approaches
• Optimizing the CI/CD pipeline
• Working on the migration of the Augmented DAM backend (another internal application used as a service within One Creative)
• Developing SQL queries to source data into Datalake tables, based on inputs from the Data Business Owner
• Documenting data extracted from the Datalake using documentation and data diagrams