Data Integration & Geo Services Engineer

Carbon60 Project Services; Portsmouth; On-site; GBP 65,000 - 90,000; Full time

Job summary

Carbon60 Project Services is seeking a Data Integration & Geo Services Engineer to join a Capability Engineering team delivering data platforms and pipelines for Royal Navy outputs.

The role focuses on building and operating containerised data services within enterprise on-premise environments, handling ingestion, processing, storage, enrichment and dissemination of data across geospatial platforms.

Qualifications

• Experience engineering data services in on-premise or self-managed hosting.
• Strong Python and SQL skills.
• Experience with data pipelines and operational production support.
• Familiar with Linux environments and networking basics.
• Experience with streaming/messaging platforms like Kafka.
• Knowledge of containerised apps in Kubernetes.
• Experience with CI/CD and infrastructure automation.
• Proficiency with geospatial data technologies and GIS platforms.
• Ability to integrate enterprise platforms via REST APIs.
• Experience with object storage and S3 interfaces.

Responsibilities

• Design, build and maintain data acquisition services from multiple sources.
• Develop event-driven and streaming data services with messaging platforms.
• Integrate enterprise platforms, APIs, databases and geospatial apps.
• Implement secure data dissemination via APIs and file exchanges.
• Contribute to solution design selecting storage and processing approaches.
• Ensure data quality, integrity and availability across platforms.
• Monitor and optimise data pipelines for performance and reliability.
• Troubleshoot complex data and platform issues.
• Contribute to automation and CI/CD of data services.
• Collaborate with stakeholders to meet data requirements.
• Produce technical runbooks and operational artefacts.

Skills

Python

SQL

Data pipelines

Linux environments

Kafka

CI/CD

Kubernetes

Geospatial data

REST APIs

Object storage

Job description

We are seeking a Data Integration & Geo Services Engineer to join a Capability Engineering team delivering data platforms and pipelines that underpin operational and analytical services supporting Royal Navy Maritime Domain Awareness outputs.

This is a hands-on engineering role, focused on building and operating containerised data and integration services within enterprise on-premise environments that collect, process, enrich and disseminate data across enterprise and geospatial platforms. You will work across the technology stack and will be expected to understand and troubleshoot the infrastructure, operating systems, networking, storage and platform services upon which data services depend.

You will work across the full data lifecycle, from ingestion through to delivery, ensuring data is accessible, trusted and usable. You will take new and existing sources of operational data and engineer reliable ways to acquire, process, store, enrich, and disseminate them. This may involve APIs, streaming data, enterprise messaging, spatial data, databases and geospatial platforms. The emphasis is on solving integration and data engineering problems rather than working with any single product or technology.

Experience with enterprise GIS technologies such as ESRI ArcGIS Enterprise would be advantageous but is not essential. We are primarily seeking experienced data engineers with strong engineering fundamentals who can apply those skills across a range of enterprise data technologies.

What You Will Do

Working within established engineering processes and standards, you will:

• Design, build and maintain data acquisition services to ingest information from APIs, message brokers, file systems, sockets, sensors and other enterprise data sources.
• Develop and support event-driven and streaming data services using enterprise messaging and integration platforms.
• Design and implement integrations between enterprise platforms, message brokers, APIs, databases, geospatial applications and external data providers.
• Design and implement mechanisms for secure dissemination of data through APIs, message brokers, file-based exchange and other operational interfaces.
• Contribute to the solution design activities, selecting appropriate storage, processing and dissemination approaches for new data sources and requirements.
• Ensure data quality, integrity and availability across platforms.
• Monitor and optimise data pipelines for performance and reliability.
• Troubleshoot and resolve complex data and platform issues.
• Contribute to automation and CI/CD of data services.
• Collaborate with stakeholders to understand and deliver data requirements.
• Produce technical documentation, runbooks and operational artefacts.

What We Are Looking For

• Experience engineering and supporting data services within on-premise or self-managed hosting environments, with an understanding of the underlying infrastructure and platform dependencies.
• Experience building and maintaining data pipelines.
• Experience diagnosing and resolving issues in operational production services.
• Strong Python and SQL skills.
• Experience working with structured data and databases.
• Understanding of event-driven architectures and messaging platforms.
• Understanding of data modelling and transformation techniques.
• Experience with Linux environments.
• Strong problem-solving and analytical skills.
• Ability to work independently within defined standards.
• Ability to learn and apply unfamiliar technologies to solve engineering problems.
• Experience with container orchestration tools or enterprise data platform technologies.
• Experience with streaming and messaging platforms such as Apache Kafka.
• Experience with CI/CD pipelines, infrastructure automation and DevOps working practices.
• Experience developing or supporting containerised applications within Kubernetes environments.
• Experience with enterprise GIS platforms and geospatial data technologies (e.g. ESRI ArcGIS Enterprise, GeoEvent, Velocity, spatial databases).
• Experience integrating enterprise platforms using REST APIs and automation.
• Experience working with object storage platforms and S3-compatible interfaces.
• Experience in secure or regulated environments.
• Experience implementing data exchange solutions across security domains or controlled information environments.
• Familiarity with service management tools (e.g. Jira, Confluence).