Data Engineer (Secure Supply Chain/Anti-Counterfeit Platform)

PolaOptix Technologies; Oxford; On-site; GBP 90,000 - 120,000; Full time

Job summary

PolaOptix Technologies seeks a seasoned Data Engineer in Oxford to design scalable data architectures that combine streaming, data lakes, data warehouses and transactional stores. You will secure data with encryption, manage keys via KMS/HSM, and connect with distributed ledgers for provenance anchoring.

Responsibilities include enabling analytics, structuring data for fast querying, and supporting BI tools like Power BI/Looker/Tableau.

Qualifications

• 5+ years in data engineering or backend data systems in AWS cloud environment.
• Proven experience building data pipelines at scale/streaming systems.
• Strong SQL and experience with data modelling (OLTP + OLAP).
• Hands-on experience with distributed data processing, data lakes and warehouses.

Responsibilities

• Design and implement scalable data architecture combining: event streaming, data lake, data warehouse and transactional database.
• Definedatabase architecture for item identity, provenance and verification events.
• Encryption at rest and in transit; field-level encryption; integration with KMS/HSM for key management.
• Integrate with permissioned ledger systems (e.g. Hyperledger Fabric) for provenance anchoring.
• Enable analytics by structuring data for efficient querying and reporting; build curated datasets and feature stores.
• Support BI tools and dashboards (Power BI, Looker, Tableau).
• Implement data access layers (APIs, views) with role-based controls.
• Monitor pipeline failures and maintain data catalogue and documentation.

Skills

Data engineering

AWS cloud

Data pipelines

SQL

Python

API-driven data systems

Data modelling (OLTP + OLAP)

Encryption / IAM

Blockchain / distributed ledger

IoT data

Privacy-preserving analytics

Regulated environments

Data quality

Data lake/warehouse

Education

Bachelor's degree in Computer Science, Engineering, Mathematics, or related field

Tools

Snowflake

Power BI

Looker

Tableau

KMS / HSM

Job description

Key Responsibilities:

Design and implement ascalable data architecturecombining:

• Event and data streaming
• Data lake (object storage, e.g. S3)
• Data warehouse (e.g. Snowflake)
• Transactional database (SQL or similar)

Definedatabase architecture for item identity, provenance and verification events

• Encryption at rest and in transit
• Field-level encryption for sensitive data
• Integration with KMS / HSM systems for key management

Integrate withpermissioned ledger systems(e.g. Hyperledger Fabric) for provenance anchoring

Enable analytics use cases by:

• Structuring data for efficient querying and reporting
• Building curated datasets and feature stores

SupportBI tools and dashboards(e.g. Power BI, Looker, Tableau)

Implementdata access layers (APIs, views)with role-based controls

Define and enforce:

• Monitoring and alerting for pipeline failures

Maintain data catalogue and documentation

Person Specification

• 5+ years indata engineering or backend data systems in AWS cloud environment
• Proven experience buildingdata pipelines at scale/streaming systems
• Strong SQL and experience withdata modelling (OLTP + OLAP)
• Hands-on experience with:
• Distributed data processing
• Data lakes and warehouses

Essential Technical Skills

• Strong programming skills (Python or equivalent) for data pipelines
• Experience withAPI-driven data systems
• Knowledge ofdata formats(Parquet, Avro, JSON)
• Understanding ofdata partitioning, indexing, and performance optimisation
• Understanding of:
• Encryption (at rest / in transit)
• Identity and access management (IAM)
• Secure handling of sensitive data
• Awareness ofdata integrity concepts:
• Hashing
• Digital signatures
• Audit trails
• Experience withblockchain / distributed ledger technologies(e.g. Hyperledger)
• Exposure tosupply chain systems or provenance tracking
• Experience withIoT or hardware-generated data
• Knowledge ofprivacy-preserving analytics(e.g. differential privacy, federated learning)
• Experience withregulated environments

Soft Skills

• Strong analytical thinking and problem-solving
• Ability to work across disciplines (software, hardware, security)
• Clear communication of complex technical concepts
• Attention to detail, especially around data correctness and integrity

Education

• Degree in Computer Science, Engineering, Mathematics, or related field