Senior Data Engineer - Industry 4.0, Real-Time AI/IIoT

Cognizant; Greater London; On-site; GBP 70,000 - 90,000; Full time

Job summary

A leading technology consultancy is seeking a Senior Data Engineer to develop scalable data platforms for Industry 4.0 initiatives. This role involves integrating data across OT and IT systems, managing data lakes, and ensuring robust governance frameworks. The ideal candidate will have strong experience in AWS or Azure platforms, proficiency in Python and SQL, and a solid understanding of data governance and quality. Join to support innovative AI/ML projects in manufacturing environments.

Qualifications

• Cloud experience with AWS and/or Azure, particularly with data services.
• Strong programming skills in Python and SQL for data manipulation.
• Expertise in ETL/ELT processes and data streaming technologies.

Responsibilities

• Architect and implement cloud-native data pipelines on AWS or Azure.
• Integrate data from OT and IT systems using various communication protocols.
• Design and manage data lakes, warehouses, and analytics platforms.
• Implement governance policies and ensure data quality compliance.

Skills

Cloud Platforms: Deep experience with AWS and/or Azure

Proficiency in Python, SQL, PySpark

Expertise in ETL/ELT and Streaming technologies

Familiarity with OT data schema

Experience in defining semantic layers

Hands-on experience with data governance frameworks

Ability to implement data quality frameworks

Knowledge of data privacy and access control

Defining and creating MLOps pipelines

Tools

Apache Airflow

Kafka

Informatica

Power BI

Terraform

Job description

A leading technology consultancy is seeking a Senior Data Engineer to develop scalable data platforms for Industry 4.0 initiatives. This role involves integrating data across OT and IT systems, managing data lakes, and ensuring robust governance frameworks. The ideal candidate will have strong experience in AWS or Azure platforms, proficiency in Python and SQL, and a solid understanding of data governance and quality. Join to support innovative AI/ML projects in manufacturing environments.