Senior Data Engineer — AI-Driven ETL & Data Pipelines

mnAi

Crawley

Hybrid

GBP 60,000 - 80,000

Full time

34 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid working options
Ownership of production data systems
Access to AI development tools
Small, collaborative engineering team

Job summary

mnAi is seeking a Senior Data Engineer to own data ingestion pipelines powering our products. You will handle data from APIs, web scraping, and structured/unstructured sources, transforming it into reliable datasets and maintaining high reliability and performance.

In this role you’ll work with OpenSearch, PostgreSQL and Snowflake, and apply AI-assisted development practices to coding, testing and documentation, while collaborating with the CTO on architecture and priorities and taking ownership

Qualifications

  • Significant experience designing, building and maintaining data ingestion and ETL/ELT pipelines.
  • Strong SQL skills and experience working with relational databases, particularly PostgreSQL.
  • Strong experience with Snowflake and dbt, including data modelling, transformation, testing and optimisation.
  • Experience integrating third-party APIs and processing data from multiple formats and sources.
  • Strong automated testing, debugging and code review experience.
  • Practical experience using AI coding assistants or agents as part of a professional development workflow.

Responsibilities

  • Design, build and maintain production-grade data ingestion and transformation pipelines using Python.
  • Integrate data from third-party APIs, web scraping, CSV, Excel, JSON, PDFs and other structured or unstructured sources.
  • Develop reliable extraction and processing workflows for complex documents, including financial statements and company information.
  • Build reusable, maintainable components for data validation, transformation and enrichment.
  • Work with PostgreSQL and Snowflake as our primary data storage and processing technologies.
  • Develop and maintain integrations with OpenSearch and other supporting data services.
  • Improve the efficiency, scalability and cost-effectiveness of existing pipelines.

Skills

SQL
PostgreSQL
Snowflake
dbt
APIs
ETL/ELT
Automated testing
AI coding assistants
Docker
CI/CD
AWS S3
OpenSearch

Tools

PostgreSQL
Snowflake
dbt
OpenSearch
Docker

Job description

mnAi is seeking a Senior Data Engineer to own data ingestion pipelines powering our products. You will handle data from APIs, web scraping, and structured/unstructured sources, transforming it into reliable datasets and maintaining high reliability and performance.

In this role you’ll work with OpenSearch, PostgreSQL and Snowflake, and apply AI-assisted development practices to coding, testing and documentation, while collaborating with the CTO on architecture and priorities and taking ownership

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer — Cloud ETL for AI Pipelines
Senior Data Engineer — Cloud ETL for AI Pipelines

AJW Group • Slinfold

On-site
GBP 65,000 - 90,000
Team fun budget
LinkedIn learning
Discretionary bonus
+4
Senior Data Engineer
Senior Data Engineer

mnAi • Crawley

Hybrid
GBP 60,000 - 80,000
Hybrid working options
Ownership of production data systems
Access to AI development tools
+1
Senior Data Platform Engineer – AI-Driven Pipelines
Senior Data Platform Engineer – AI-Driven Pipelines

Voltility • Greater London

On-site
GBP 90,000 - 130,000
Senior Data Engineer — AI-Driven Data Platform
Senior Data Engineer — AI-Driven Data Platform

Xeneta • Greater London

Hybrid
GBP 90,000 - 130,000
Trust, autonomy, impact
Transparent and open work environment
Individual education budget
+2
Lead Data Engineer — AI Data Platform & Pipelines
Lead Data Engineer — AI Data Platform & Pipelines

Resume Skip • Greater London

On-site
GBP 90,000 - 130,000
Unlimited leaves
Life insurance & private health
No hierarchy
+1
Senior Data Engineer — Cloud Data Pipelines Lead
Senior Data Engineer — Cloud Data Pipelines Lead

Netcompany • Ledston

Hybrid
GBP 70,000 - 100,000
Hybrid working model
25 days holiday
Private Medical Health care via Vitaly
+5
Senior Data Engineer - AI-Driven Data Pipelines
Senior Data Engineer - AI-Driven Data Pipelines

Moody's Corporation • Manchester

On-site
GBP 70,000 - 110,000
Senior Data Engineer
Senior Data Engineer

Understanding Recruitment • Greater London

On-site
GBP 85,000 - 120,000
Data Engineer — AI-Driven Data Pipelines
Data Engineer — AI-Driven Data Pipelines

Transformuk • Greater London

On-site
GBP 65,000 - 95,000
Holiday entitlement, 28 days (buy/sell
Private healthcare
Pension eligibility
+5
Senior Data Engineer - Scalable AI Data Platform
Senior Data Engineer - Scalable AI Data Platform

The BDPN • Greater London

Hybrid
GBP 110,000 - 160,000