Data Engineer: Build Scalable Data Lakes & AI Pipelines

Inforcer Ltd.; Richmond; On-site; GBP 65,000 - 90,000; Full time

Job summary

Inforcer Ltd. is seeking a Data Engineer to design, build and maintain the infrastructure powering our automation and AI platforms. You will develop scalable data pipelines, integrate data from multiple systems and build foundations for a modern data lake architecture.

You’ll work with stakeholders to ensure data is accessible, reliable and ready for analytics and AI initiatives. The role focuses on designing data architectures, implementing ingestion patterns, and maintaining robust data

Qualifications

• Proven experience as a Data Engineer or similar role.
• Strong SQL skills with large datasets.
• Experience building ETL/ELT pipelines.
• Experience developing data integrations and ingestion frameworks.
• Strong Python development skills.
• Experience in cloud-based data environments.
• Knowledge of data modelling and database design principles.
• Experience with Azure and Azure Data Lake Storage (ADLS).
• Experience with data engineering tools such as Azure Data Factory, Databricks, Apache Spark, dbt or Airflow.
• Experience with cloud data platforms such as Azure Synapse Analytics or Snowflake.
• Experience using Git for version control.
• Experience integrating REST APIs and working with event-driven architectures.
• Knowledge of Kafka or other streaming technologies.
• Understanding of change data capture (CDC) patterns.
• Knowledge of data governance and master data management practices.
• A collaborative approach with the ability to communicate clearly with technical and non-technical stakeholders.

Responsibilities

• Design and maintain a scalable data lake and modern data platform architecture.
• Develop efficient data storage solutions for structured and unstructured datasets.
• Support data governance, security and compliance requirements.
• Optimise data models and storage performance.
• Develop and maintain data ingestion frameworks for internal and external systems.
• Build integrations across SaaS platforms, databases, APIs and third-party applications.
• Implement batch and real-time data ingestion patterns.
• Manage data synchronisation and change data capture (CDC) processes.
• Design, develop and maintain ETL/ELT pipelines.
• Transform raw data into trusted, business-ready datasets.
• Monitor pipeline performance and proactively resolve issues.
• Improve reliability, scalability and automation across the data estate.
• Implement data validation and quality controls.
• Create monitoring and alerting mechanisms for critical pipelines.
• Troubleshoot data issues and conduct root cause analysis.
• Ensure high levels of availability and integrity across the platform.
• Work closely with business stakeholders, analysts, engineers and leadership teams.
• Support reporting, analytics and AI initiatives through reliable data delivery.
• Contribute to data architecture decisions and platform roadmaps.
• Document solutions and promote engineering best practices.

Skills

SQL

ETL pipelines

Python

Azure

Databricks

Spark

dbt

Airflow

REST APIs

Kafka

CDC patterns

Data governance

Cloud data platforms

Tools

Azure Data Factory

Databricks

Apache Spark

Git

Azure Synapse

Snowflake

DBT

Job description

Inforcer Ltd. is seeking a Data Engineer to design, build and maintain the infrastructure powering our automation and AI platforms. You will develop scalable data pipelines, integrate data from multiple systems and build foundations for a modern data lake architecture.

You’ll work with stakeholders to ensure data is accessible, reliable and ready for analytics and AI initiatives. The role focuses on designing data architectures, implementing ingestion patterns, and maintaining robust data