Part-Time Data Engineer: AI-Ready Data Pipelines

Neurons Lab; Poland; On-site; PLN 78,000 - 112,000; Part time

Job summary

Neurons Lab is seeking a Data Engineer (part-time) to join a flagship engagement with a European private investment group. You’ll build the ingestion layer, perform entity resolution, and set up vector/graph storage pipelines over unstructured data.

The role emphasizes scalable, cost-aware pipelines, privacy, and repeatable operations. You will work with an AI Architect and Analyst, delivering runbooks and monitored pipelines during a 20‑hour workweek.

Responsibilities

• Stand up capture by default: notetaker on every call with speaker attribution, plus ingestion from mail, Slack and messengers — designed as opt‑out, not opt‑in, and reversible if the client changes their mind.
• Backfill the archive: years of historical email, Slack, board protocols, decks and portfolio updates — parsed, deduplicated and dated correctly.
• Build document parsing for the awkward long tail: PDFs, scanned board packs, spreadsheets, slide decks, forwarded attachments.
• Implement identity / entity resolution: the same person across Slack handle, mail alias and calendar invite; the same portfolio company across a deck, a mail thread and a CRM record.
• Build chunking and embedding pipelines and load the vector + graph stores behind the ontology the architect defines.
• Implement incremental sync through the connector layer (MCP / Composio-class) — no full re‑crawls, no silent drift, clear handling of edits and deletions.
• Attach access scope and provenance to every record at ingestion, so permission‑aware retrieval and audit are possible downstream rather than bolted on.
• Run PII detection, redaction and retention logic; evidence to the client's security function what is stored, where, and for how long.
• Orchestrate with Airflow / Step Functions; build repeatable, monitored pipelines rather than scripts, with alerting when a source stops flowing.
• Keep cost and latency under control at volume — batching, incremental embedding, storage tiering — and report the unit economics.
• Write runbooks so the client's own team can operate this after handover.

Job description

Neurons Lab is seeking a Data Engineer (part-time) to join a flagship engagement with a European private investment group. You’ll build the ingestion layer, perform entity resolution, and set up vector/graph storage pipelines over unstructured data.

The role emphasizes scalable, cost-aware pipelines, privacy, and repeatable operations. You will work with an AI Architect and Analyst, delivering runbooks and monitored pipelines during a 20‑hour workweek.