Data Engineer — AI-Driven Pipelines & Delta Lake

Jobtailor; Norwich; On-site; GBP 65,000 - 90,000; Full time

Job summary

Jobtailor is seeking a data engineer to design, develop, and optimise data warehouse solutions, and to build robust ETL/ELT pipelines that turn raw data into actionable insights.

You will develop and manage integrations between systems (including APIs), ensure data quality, and contribute to CI/CD and DevOps practices while collaborating with both technical and non-technical stakeholders to deliver data-driven outcomes.

Qualifications

• Experience with data warehousing concepts and architectures.
• Strong knowledge of ETL/ELT processes and data transformation.
• Experience integrating systems using APIs or other methods.
• Familiarity with modern data technologies (Parquet, Delta tables/lakes).
• Ability to perform exploratory data analysis using tools such as Excel or programming languages.
• Experience with Git, CI/CD, and DevOps practices.
• Strong problem-solving skills and attention to detail.
• A collaborative mindset with the ability to work with technical and non-technical stakeholders.

Responsibilities

• Designing, developing, and optimisation data warehouse solutions
• Building and maintaining ETL/ELT pipelines to transform raw data into usable insights
• Developing and managing integrations between systems (including APIs)
• Ensuring data quality, integrity, and consistency across platforms
• Implementing monitoring, alerting, and performance optimisation
• Supporting medallion architecture and modern data lake practices (e.g., Delta Lakes)
• Contributing to CI/CD pipelines, DevOps practices, and source control (Git)
• Collaborating with stakeholders to deliver valuable, data-driven outcomes
• Supporting AI, machine learning, and advanced analytics use cases
• Driving automation across data pipelines and processes

Job description

• Designing, developing, and optimising data warehouse solutions
• Building and maintaining ETL/ELT pipelines to transform raw data into usable insights
• Developing and managing integrations between systems (including APIs)
• Ensuring data quality, integrity, and consistency across platforms
• Implementing monitoring, alerting, and performance optimisation
• Supporting medallion architecture and modern data lake practices (e.g., Delta Lakes)
• Contributing to CI/CD pipelines, DevOps practices, and source control (Git)
• Collaborating with stakeholders to deliver valuable, data-driven outcomes
• Supporting AI, machine learning, and advanced analytics use cases
• Driving automation across data pipelines and processes

Requirements

• Experience with data warehousing concepts and architectures
• Strong knowledge of ETL/ELT processes and data transformation
• Experience integrating systems using APIs or other methods
• Familiarity with modern data technologies (e.g., Parquet, Delta tables/lakes)
• Ability to perform exploratory data analysis using tools such as Excel or programming languages
• Experience with Git, CI/CD, and DevOps practices
• Strong problem-solving skills and attention to detail
• A collaborative mindset with the ability to work with technical and non-technical stakeholders

🔍 ATS Optimization Keywords
Below are skills and terms extracted directly from this job posting to improve Applicant Tracking System (ATS) visibility. This unique feature helps candidates tailor their applications more effectively — a feature exclusive to JobTailor job listings.

Hard Skills

• data warehousing
• ETL
• ELT
• API integration
• data quality
• performance optimisation
• CI/CD
• DevOps
• data analysis
• automation

Soft Skills

• problem-solving
• attention to detail
• collaboration
• stakeholder engagement