Data engineering & AI-ready software architecture

SFBI; Marquette-lez-Lille; On-site; EUR 6,700 - 11,000; Full time

Benefits offered by this job

Open to people with disabilities

Job summary

Lesaffre is offering an internship at the NMH/BioData interface to build a web interface (Streamlit) and a Python layer that converts raw instrument output into a clean, describable, queryable experimental result. You will work with NMH scientists and a BioData DevOps engineer to enable AI-ready data, reproducibility, and data-driven insights.

The role focuses on automated data ingestion, schema modeling, and developing queryable data pipelines, with emphasis on clean code, testing, and

Qualifications

• Master 2 or final year of Engineering School at a French university or higher education institution (mandatory).
• Must hold valid authorization to work in France.
• Major in Computer Science, Software Engineering or Data Engineering.

Responsibilities

• Instrument data acquisition & parsing from laboratory instruments and formats.
• Data standardization & schema modeling for interoperability and reproducibility.
• Architect datasets and develop tools/endpoints for autonomous querying and analysis.
• Expose processing services via REST APIs and lightweight interfaces like Streamlit.
• Follow Biodata's software engineering practices: Docker, Git, tests, and documentation.

Skills

Python

Git

Docker

Data processing

Education

Master 2 / Engineering School (final year)

Authorization to work in France

CS/Software/Data Engineering focus

Tools

Streamlit

REST APIs

JSON Schemas

Job description

Description

Major global fermentation player for more than a century, Lesaffre, with more than 3 billion euros in revenue, has a presence on all continents, with 11,000 employees from over 90 nationalities. Using our expertise and diversity, we collaborate with clients, partners, and scientists to find increasingly relevant responses to the needs of nutrition, health, naturalness, and respect for our environment. Thus, every day, we explore and reveal the infinite potential of microorganisms.

Feeding 9 billion people in 2050 in a healthy way while using the planet's resources in the most efficient manner is a major and unprecedented challenge. We believe that fermentation is one of the most promising answers to this challenge.

Lesaffre : Working together to better nourish and protect the planet.

Lesaffre is a leader in bioengineering & bioprocesses and places RD&I at the heart of its success: more than 850 experts worldwide explore the potential of microorganisms and natural fermentation to serve human, plant, and animal needs.

You will join this research community at the interface of two RD&I teams: NMH (Nutrition, Microbiota & Health), which runs experimental science (microbiological assays, imaging, microbiota work), and BioData, focusing on data science and bioinformatics team that builds the computational tools used by our scientists. You will be co-mentored by an NMH Scientist and a BioData DevOps engineer.

The scientific problem

Every week, NMH experiments produce large volumes of heterogeneous measurements: plate-reader kinetics, microbiological assay readouts, imaging data, each in the native format of the instrument that produced it. Today, turning that raw output into an analysable result is largely manual:

• Experimental time is lost to data wrangling rather than to designing and running the next experiment.
• Results are hard to compare across campaigns, because the same biological variable is recorded differently depending on the instrument, the operator, and the date.
• Reprocessing a past experiment is difficult, which limits reproducibility and prevents the accumulated data from being reused to generate new hypotheses.

Internship goal: build a web interface in streamlit, python layer that takes raw instrument output to a clean, described, queryable experimental result and make that result directly consumable by modern AI architectures (LLM, RAG pipelines, autonomous agents), so that a scientist can interrogate their own data in natural language.

Key responsibilities

• Instrument data acquisition & parsing: Design automated extraction modules capable of ingesting raw experimental data streams from various laboratory instruments and heterogeneous file formats, ensuring cleaning, typing, and quality control.
• Data standardization & schema modeling: Define and implement strict, unified data schemas (metadata, type validation, JSON serialization formats) to ensure data interoperability and reproducibility.
• Architecture: Structure datasets and develop tools/function calling endpoints, enabling AI agents or LLM/RAG pipelines to autonomously query, analyze, and manipulate standardized datasets.
• API & internal tooling: Expose processing services via REST APIs and build lightweight interfaces (e.g., Streamlit) enabling scientific teams to visualize, validate, and query data independently.
• Apply Biodata's software engineering best practices: containerization (Docker), version control (Git), unit/integration testing, and technical documentation.

By the end of the internship you will deliver a deployed, operational standardization pipeline for at least one NMH data family; a documented experimental data schema; an LLM-queryable access layer; and a lightweight interface used by the scientific team. Success will be demonstrated via a live demo, automated tests, deployment instructions, a short technical report, and readiness for inclusion in the supported scientific campaign.

Education

• Currently enrolled in a Master 2 or final year of Engineering School at a French university or higher French education institution (mandatory for the internship agreement / convention de stage).
• Must already hold valid authorization to work in France.
• Major in Computer Science, Software Engineering or Data Engineering.

Technical

• Languages & data processing: advanced Python proficiency.
• Software engineering: Git, environment management, containerization concepts (Docker, TF).
• AI & data integration: data indexing concepts, databases, and LLM/agent integration patterns (function calling, JSON schemas).
• Appreciated: handling scientific and tabular data (units, dilutions, replicates, plate formats, time series), and any exposure to bioinformatics or laboratory data.

Mindset & interpersonal

• Computer science / software engineering background. No prior biology background is required the scientific context will be provided by the research teams but genuine curiosity for microbiology and fermentation is expected: you will be modelling biological experiments, not generic records.
• Rigorous approach, strong abstraction skills, and commitment to code quality (Clean Code).
• Strong interpersonal skills for a multidisciplinary environment: you will sit with biologists and microbiota experts, understand how an experiment is carried out, and translate that into technical specifications

Languages

• Fluent English (written and spoken)

Other info

This internship is open to people with disabilities.