Data Engineer: Build Scalable Data Lakes & AI Pipelines

Inforcer; Greater London; On-site; GBP 75,000 - 110,000; Full time

Job summary

Inforcer in London is seeking a Data Engineer to design, build and maintain the infrastructure powering our automation and AI platforms. You will develop scalable data pipelines, integrate data from multiple systems and lay the foundations of a modern data lake architecture.

Work with stakeholders to ensure data is accessible, reliable and ready for analytics, reporting, automation, and AI initiatives. You will tackle complex data challenges and implement robust integrations to support rapid

Qualifications

• Proven experience as a Data Engineer or in a similar role.
• Strong SQL skills and experience with large datasets.
• Commercial experience building ETL/ELT pipelines.
• Experience developing data integrations and ingestion frameworks.
• Strong Python development skills.
• Experience working within cloud-based data environments.
• Knowledge of data modelling and database design principles.
• Experience with Microsoft Azure and Azure Data Lake Storage (ADLS).
• Experience with data engineering tools such as Azure Data Factory, Databricks, Apache Spark, dbt or Airflow.
• Experience with cloud data platforms such as Azure Synapse Analytics or Snowflake.
• Experience using Git for version control.
• Experience integrating REST APIs and working with event-driven architectures.
• Knowledge of Kafka or other streaming technologies.
• Understanding of change data capture (CDC) patterns.
• Knowledge of data governance and master data management practices.

Responsibilities

• Design and maintain a scalable data lake and modern data platform architecture.
• Develop efficient data storage solutions for structured and unstructured datasets.
• Support data governance, security and compliance requirements.
• Optimise data models and storage performance.
• Develop and maintain data ingestion frameworks for internal and external systems.
• Build integrations across SaaS platforms, databases, APIs and third-party applications.
• Implement batch and real-time data ingestion patterns.
• Manage data synchronisation and change data capture (CDC) processes.
• Design, develop and maintain ETL/ELT pipelines.
• Transform raw data into trusted, business-ready datasets.
• Monitor pipeline performance and proactively resolve issues.
• Improve reliability, scalability and automation across the data estate.
• Implement data validation and quality controls.
• Create monitoring and alerting mechanisms for critical pipelines.
• Troubleshoot data issues and conduct root cause analysis.
• Ensure high levels of availability and integrity across the platform.
• Work closely with business stakeholders, analysts, engineers and leadership teams.
• Support reporting, analytics and AI initiatives through reliable data delivery.
• Contribute to data architecture decisions and platform roadmaps.
• Document solutions and promote engineering best practices.

Skills

Data Engineering

SQL

ETL/ELT

Data Integrations

Python

Cloud Data

Data Modelling

Azure

Azure Data Factory

Databricks

Apache Spark

dbt

Airflow

Git

REST APIs

Kafka

CDC

Data Governance

Tools

Azure Data Factory

Databricks

Apache Spark

dbt

Airflow

Snowflake

Azure Synapse Analytics

Job description

Inforcer in London is seeking a Data Engineer to design, build and maintain the infrastructure powering our automation and AI platforms. You will develop scalable data pipelines, integrate data from multiple systems and lay the foundations of a modern data lake architecture.

Work with stakeholders to ensure data is accessible, reliable and ready for analytics, reporting, automation, and AI initiatives. You will tackle complex data challenges and implement robust integrations to support rapid