Data Engineer, AI Infrastructure & Search (Equity)

Solve Intelligence, Inc.; Greater London; Hybrid; GBP 100,000 - 160,000; Full time

Benefits offered by this job

Significant equity

Founding impact

Visa sponsorship

Private medical insurance

Free meals

Job summary

Solve Intelligence, Inc. is seeking a data engineer to build the ingestion and search systems behind our AI products. You will own systems from source acquisition through serving queries, handling large-scale ingestion, document processing, and search across diverse data sources.

You will collaborate with AI researchers and product engineers, driving performance optimization and scalable data infrastructure for tens of millions of records.

Qualifications

• Strong Python and SQL, with experience designing and operating production databases.
• Experience building and operating production data pipelines over large, messy datasets.
• Expertise with running search systems over large document collections.
• End-to-end ownership from raw data to user-facing functionality.
• Good understanding of schema design, indexing and query optimisation.
• Track record of diagnosing and fixing performance bottlenecks in live systems through profiling and measurement.

Responsibilities

• Large-scale ingestion: build and operate high-throughput, resumable pipelines for large datasets with monitoring and recovery.
• Document processing and data quality: extract content from complex documents and formats, validate outputs while preserving structure.
• Search and serving: build keyword, vector and structured search with scalable schemas, indexes and partitioning.
• Connecting information across sources: link patents, scientific records and sources with traceability.
• Performance engineering: profile parsing, ingestion, database builds and queries to optimize throughput and latency.

Skills

Python

SQL

Production databases

Data pipelines

Performance profiling

Tools

PostgreSQL/pgvector

OpenSearch/Elasticsearch

Spark/Delta Lake

AWS

Job description

Solve Intelligence, Inc. is seeking a data engineer to build the ingestion and search systems behind our AI products. You will own systems from source acquisition through serving queries, handling large-scale ingestion, document processing, and search across diverse data sources.

You will collaborate with AI researchers and product engineers, driving performance optimization and scalable data infrastructure for tens of millions of records.