Data Engineer: Unstructured Data & Real-Time Pipelines

Acorn Insurance Ltd; West Kirby; Hybrid; GBP 65,000 - 70,000; Full time

Benefits offered by this job

35 days holiday

Mental health support

Career development

Flexible benefits

Hybrid working

Recognition awards

Job summary

Acorn Insurance Ltd, based in Liverpool, invites a Data Engineer to design and implement robust data ingestion pipelines for unstructured data, while building scalable storage like data lakes and NoSQL databases. You will work with data scientists, analysts, and engineers to ensure data quality and availability.

The role emphasizes NLP/OCR processing, data governance, and real-time cloud streaming, with hybrid working options and a focus on secure, high-performance database environments.

Qualifications

• Experience with unstructured data including voice, chat, image.
• Proven ability to manage secure, high-performance database environments.
• Excellent communication and cross-functional collaboration skills.
• A passion for continuous learning and innovation.

Responsibilities

• Design and implement robust data ingestion pipelines for unstructured data using modern data engineering tools and frameworks.
• Develop and maintain scalable storage solutions (e.g., data lakes, NoSQL databases) optimized for unstructured data.
• Collaborate with data scientists, analysts, and software engineers to ensure data availability, quality, and usability.
• Apply data parsing, extraction, and transformation techniques (e.g., NLP, OCR, image/audio processing).
• Implement data governance, metadata management, and data cataloging for unstructured data assets.
• Monitor and optimize data workflows for performance, reliability, and cost-efficiency.
• Ensure compliance with data privacy and security standards.
• Share knowledge and mentor team members
• Stay ahead of the curve with the latest database technologies
• Experience of real time cloud streaming solutions

Skills

Unstructured data

High-performance DB

Communication

Continuous learning

Tools

Databricks

Azure Fabric

Confluent

Apache Flink

Job description

Acorn Insurance Ltd, based in Liverpool, invites a Data Engineer to design and implement robust data ingestion pipelines for unstructured data, while building scalable storage like data lakes and NoSQL databases. You will work with data scientists, analysts, and engineers to ensure data quality and availability.

The role emphasizes NLP/OCR processing, data governance, and real-time cloud streaming, with hybrid working options and a focus on secure, high-performance database environments.