Software Engineer - Data Pipelines, NLP & ML (Hybrid UK)

Theia Insights; Greater London; Hybrid; GBP 90,000 - 130,000; Full time

Benefits offered by this job

EMI share options

Hybrid UK (London or Cambridge)

Private health insurance

Pension

25 days holiday

Job summary

Theia Insights is seeking a data/ML engineer to build and maintain pipelines that classify global equities using multi-level taxonomies. You will run large-scale NLP/LLM inference over company documents and ingest market data for distribution.

We value practical ML in production, embeddings, and semantic similarity, with a strong focus on cost and throughput in batch processing within an AWS-based stack. Hybrid UK work from London or Cambridge is offered.

Qualifications

• Strong production Python capabilities with reliable data pipelines.
• Experience handling datasets in Pandas and Parquet/Arrow.
• Hands-on with batch orchestration tools (Dagster or Airflow).
• Applied ML in production, including embeddings and semantic similarity.
• AWS fluency and CI/CD discipline.

Responsibilities

• Build and maintain pipelines that classify equities using a five-level taxonomy.
• Run large-scale NLP and LLM inference on company documents with batch execution.
• Ingest market data and publish datasets to external distributors.
• Own schema and contract evolution for downstream datasets.

Skills

Production Python

Pandas/Parquet

Batch pipelines

NLP/LLM inference

AWS & CI/CD

Embeddings

Semantic similarity

Tools

DuckDB

Snowflake

Dagster/Airflow

S3 data flows

Job description

Theia Insights is seeking a data/ML engineer to build and maintain pipelines that classify global equities using multi-level taxonomies. You will run large-scale NLP/LLM inference over company documents and ingest market data for distribution.

We value practical ML in production, embeddings, and semantic similarity, with a strong focus on cost and throughput in batch processing within an AWS-based stack. Hybrid UK work from London or Cambridge is offered.