Geo-Demographic Data Engineer for Large-Scale Pipelines

Qualient Technology Solutions UK Limited; Leeds; On-site; GBP 60,000 - 90,000; Full time

Job summary

Qualient Technology Solutions UK Limited in Leeds is seeking a Data Engineer to work with demographic and geospatial data. You will design and maintain production pipelines using Databricks, PySpark and SQL, and manage Delta Lake with batch and incremental processing.

You will handle geospatial data, coordinate reference systems, and ensure data quality while enabling scalable Spark-based analytics. Candidates will engage with analysts and data owners to document data issues, apply governance,

Qualifications

• Strong Databricks, Python, PySpark and SQL skills.
• Experience with Delta Lake, ingestion and schema management.
• Geospatial data engineering with points, polygons, spatial joins.
• Knowledge of coordinate reference systems including British National Grid and WGS84.
• Experience with a scalable Spark spatial approach or Apache Sedona.
• Ingest and transform GeoJSON, WKT/WKB and Shapefile or GeoParquet.
• Experience joining demographic data to geographic reference data.
• Data quality and reconciliation skills including detecting mismatches and duplicates.
• Experience with Git, CI/CD, code review, automated testing and monitoring.

Skills

Databricks

Python

PySpark

SQL

Geospatial data engineering

Delta Lake

Tools

Git

CI/CD

Code review

Automated testing

Job monitoring

Apache Sedona

Spark spatial

Job description

Qualient Technology Solutions UK Limited in Leeds is seeking a Data Engineer to work with demographic and geospatial data. You will design and maintain production pipelines using Databricks, PySpark and SQL, and manage Delta Lake with batch and incremental processing.

You will handle geospatial data, coordinate reference systems, and ensure data quality while enabling scalable Spark-based analytics. Candidates will engage with analysts and data owners to document data issues, apply governance,