Data Engineer – Cloud Pipelines & Migration

Netcompany

Ledston

Hybrid

GBP 70,000 - 95,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid working
25 days holiday
Private Medical Health care
Pension contribution & Life Assurance
Certifications supported
Employee discounts
Employee Resource Groups

Job summary

Netcompany is seeking a Data Engineer to build repeatable pipelines for a large-scale data migration, handling ingestion, transformation and delivery into a single platform.

You will work with the migration team, data lead and cloud platforms to design reliable data processing using SQL, Python, PySpark and dbt, with Delta Lake and infrastructure as code. Hybrid working and ongoing professional development are offered.

Qualifications

  • Hands-on experience building and operating data pipelines in a migration environment.
  • Experience with Spark, PySpark, Databricks or similar technologies.
  • Strong SQL and Python skills for transformations, validation and reconciliation.
  • Experience with cloud-native orchestration tools and IaC (Terraform or equivalent).

Responsibilities

  • Build repeatable processes to receive, unpack, validate and ingest data from multiple sources.
  • Transform source extracts into consistent structures for migration to a single platform.
  • Develop maintainable ingestion and transformation code using SQL, Python, PySpark and dbt.
  • Implement automated checks to ensure data completeness and accuracy across the pipeline.
  • Monitor, diagnose and recover failed or incomplete data processing.
  • Maintain auditable data source mappings, transformations and outcomes with proper controls.

Skills

Data pipelines
Cloud platforms (Azure/AWS/GCP)
Spark / PySpark / Databricks
dbt transformations
SQL
Python
Orchestration tools
Delta Lake
Terraform

Job description

Netcompany is seeking a Data Engineer to build repeatable pipelines for a large-scale data migration, handling ingestion, transformation and delivery into a single platform.

You will work with the migration team, data lead and cloud platforms to design reliable data processing using SQL, Python, PySpark and dbt, with Delta Lake and infrastructure as code. Hybrid working and ongoing professional development are offered.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Hybrid Data Engineer—Cloud Pipelines & Migrations
Hybrid Data Engineer—Cloud Pipelines & Migrations

Netcompany1 • Leeds

Hybrid
GBP 60,000 - 90,000
Hybrid working model
25 days holiday
Private medical health care
+5
Senior Data Engineer: Cloud Data Pipelines & Migration
Senior Data Engineer: Cloud Data Pipelines & Migration

Netcompany1 • Leeds

Hybrid
GBP 65,000 - 90,000
Hybrid working model
25 days holiday
Private Medical Health care via Vitaly
+5
Data Engineer: Cloud Pipelines & Migrations
Data Engineer: Cloud Pipelines & Migrations

Netcompany Group A/S • Leeds

Hybrid
GBP 65,000 - 80,000
Hybrid work
Private medical
Pension
+3
Senior Data Engineer: Cloud Pipelines & Migration Expert
Senior Data Engineer: Cloud Pipelines & Migration Expert

Netcompany1 • Greater London

Hybrid
GBP 65,000 - 90,000
Hybrid working model
25 days' holiday
Private Medical Health care via Vital1
+5
Senior Data Engineer — Cloud Data Pipelines Lead
Senior Data Engineer — Cloud Data Pipelines Lead

Netcompany • Ledston

Hybrid
GBP 70,000 - 100,000
Hybrid working model
25 days holiday
Private Medical Health care via Vitaly
+5
Senior Data Engineer: Cloud Data Pipelines & Migrations
Senior Data Engineer: Cloud Data Pipelines & Migrations

Netcompany Group A/S • Leeds

Hybrid
GBP 60,000 - 90,000
Hybrid working model
Private Medical Health care via Vitaly
Pension contribution and Life Assuar
+3
Senior Data Engineer – Cloud Data Pipelines & Migration
Senior Data Engineer – Cloud Data Pipelines & Migration

Netcompany • Leeds

On-site
GBP 60,000 - 85,000
Hybrid working model with some flexi-
Private Medical Health care via Vital
Pension contribution, Life Assurance
+3
Senior Data Engineer: Migration & Data Pipelines (Hybrid)
Senior Data Engineer: Migration & Data Pipelines (Hybrid)

Netcompany • Greater London

Hybrid
GBP 75,000 - 110,000
Hybrid working model
Private medical health care
Pension contribution
+3
Hybrid Cloud Data Pipeline Engineer for Migrations
Hybrid Cloud Data Pipeline Engineer for Migrations

Netcompany • Leeds

Hybrid
GBP 60,000 - 90,000
Hybrid working model with some flexi
Private Medical Health care via Vitaly
Pension contribution
+4
Data Engineer
Data Engineer

Netcompany • Ledston

Hybrid
GBP 70,000 - 95,000
Hybrid working
25 days holiday
Private Medical Health care
+4