GCP Data Platform Architect - ETL/ELT & BigQuery

HCL Technologies Limited; Greater London; On-site; GBP 90,000 - 120,000; Full time

Job summary

HCL Technologies Limited in London seeks a Senior Data Engineer to design, build, test, deploy, and maintain scalable ETL/ELT pipelines for structured and unstructured data. You will work with BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services, developing data-processing components in Java or Python and leveraging Docker and Kubernetes.

Collaborating with architects, analysts, application and platform teams, you will enforce data quality, security, CI/CD, and observability to

Qualifications

• Degree in Computer Science or a related discipline.
• Experience delivering software solutions in agile teams.
• Knowledge of modern development frameworks, tools and engineering practices.

Responsibilities

• Design, develop, test, deploy, and maintain scalable ETL/ELT pipelines for structured and unstructured data.
• Build batch and real-time processing solutions using BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services.
• Develop data-processing components and integrations using Java or Python, SQL, REST APIs, Kafka, and containerized services on GKE.
• Implement reusable ingestion and transformation frameworks supporting full, incremental, and event-driven loads.
• Design data models and optimize BigQuery tables through partitioning, clustering, efficient SQL, and cost-aware processing patterns.

Skills

BigQuery

Dataflow

SQL

Java/Python

Kafka

GKE

Education

Degree in CS/SE

Tools

Docker

Kubernetes

Git

CI/CD

Airflow

Cloud Composer

Job description

HCL Technologies Limited in London seeks a Senior Data Engineer to design, build, test, deploy, and maintain scalable ETL/ELT pipelines for structured and unstructured data. You will work with BigQuery, Dataflow, Cloud Storage, Pub/Sub, and related GCP services, developing data-processing components in Java or Python and leveraging Docker and Kubernetes.

Collaborating with architects, analysts, application and platform teams, you will enforce data quality, security, CI/CD, and observability to