Founding Data Engineer — Scale Ingestion & Search Systems

Solveintelligence; Greater London; On-site; GBP 85,000 - 130,000; Full time

Benefits offered by this job

Visa sponsorship

Private medical insurance

Free meals

Founding equity

Job summary

Solve Intelligence, a fast-growing IP technology startup, is hiring a data engineer to build ingestion and search systems for AI products. You’ll handle data from patents, case law, scientific databases and web content, spanning structured records, documents, images, audio and video.

You’ll own systems from source acquisition to serving queries. You’ll design and operate large-scale pipelines, implement robust document processing, and enable fast, scalable search across tens to hundreds of

Qualifications

• Strong Python and SQL, with experience designing and operating production databases.
• Solid experience building and operating production data pipelines over large, messy datasets.
• Expertise with running search systems over large document collections.
• End-to-end ownership from raw data to user-facing functionality.
• A good understanding of schema design, indexing and query optimisation.
• A track record of diagnosing and fixing performance bottlenecks in live systems through profiling and measurement.

Responsibilities

• Large-scale ingestion: build and operate high-throughput, resumable pipelines for large datasets with incremental updates and recovery from failures.
• Document processing and data quality: extract content from complex documents and validate outputs while preserving structure.
• Search and serving: build keyword, vector and structured search with efficient schemas and indexes for fast queries over millions of records.
• Connecting information across sources: link patents and scientific records; preserve dates and versions.
• Performance engineering: profile parsing, ingestion, database builds and queries to optimize throughput, latency and cost.

Skills

Python

SQL

Data pipelines

Production databases

Tools

PostgreSQL

pgvector

OpenSearch

Spark/Delta Lake

AWS

Job description

Solve Intelligence, a fast-growing IP technology startup, is hiring a data engineer to build ingestion and search systems for AI products. You’ll handle data from patents, case law, scientific databases and web content, spanning structured records, documents, images, audio and video.

You’ll own systems from source acquisition to serving queries. You’ll design and operate large-scale pipelines, implement robust document processing, and enable fast, scalable search across tens to hundreds of