ESRI Data Engineer

Carbon60 Project Services; Portsmouth; On-site; GBP 55,000 - 90,000; Full time

Job summary

Carbon60 Project Services is seeking a Data Integration & Geo Services Engineer to join a Capability Engineering team delivering data platforms and pipelines underpinning Royal Navy outputs. This hands-on role focuses on containerised data services in enterprise on-prem environments, spanning ingestion, processing, storage, enrichment and dissemination across GIS platforms.

You will design, build, operate and troubleshoot data services, with strong Python/SQL and Linux foundations, aiming for

Qualifications

• Experience building and operating data pipelines in on-prem environments.
• Strong Python and SQL skills demonstrated in production.
• Experience with Linux environments and infrastructure basics.
• Ability to troubleshoot production data services independently.
• Familiarity with event-driven architectures and messaging platforms.

Responsibilities

• Design, build and maintain data acquisition services ingesting from APIs, brokers, files and sensors.
• Develop and support event-driven and streaming data services using enterprise messaging.
• Design and implement integrations between platforms, brokers, databases and geospatial apps.
• Ensure secure data dissemination via APIs and file-based exchanges.
• Contribute to solution design selecting storage, processing and dissemination approaches.
• Maintain data quality, integrity and availability across platforms.
• Monitor and optimize data pipelines for performance and reliability.
• Troubleshoot and resolve complex data and platform issues.
• Contribute to automation and CI/CD of data services.
• Collaborate with stakeholders to deliver data requirements and produce runbooks.
• Produce technical documentation and operational artefacts.

Skills

Python

SQL

Linux

Data pipelines

Problem-solving

Independent work

Event-driven architectures

Education

Bachelor's degree in Computer Science or related

Tools

Kafka

Kubernetes

CI/CD

Docker

REST APIs

Jira

Confluence

ESRI ArcGIS Enterprise

S3-compatible storage

Job description

We are seeking a Data Integration & Geo Services Engineer to join a Capability Engineering team delivering data platforms and pipelines that underpin operational and analytical services supporting Royal Navy Maritime Domain Awareness outputs.

This is a hands-on engineering role, focused on building and operating containerised data and integration services within enterprise on-premise environments that collect, process, enrich and disseminate data across enterprise and geospatial platforms. You will work across the technology stack and will be expected to understand and troubleshoot the infrastructure, operating systems, networking, storage and platform services upon which data services depend.

You will work across the full data lifecycle, from ingestion through to delivery, ensuring data is accessible, trusted and usable. You will take new and existing sources of operational data and engineer reliable ways to acquire, process, store, enrich, and disseminate them. This may involve APIs, streaming data, enterprise messaging, spatial data, databases and geospatial platforms. The emphasis is on solving integration and data engineering problems rather than working with any single product or technology.

Experience with enterprise GIS technologies such as ESRI ArcGIS Enterprise would be advantageous but is not essential. We are primarily seeking experienced data engineers with strong engineering fundamentals who can apply those skills across a range of enterprise data technologies.

What You Will Do

• Design, build and maintain data acquisition services to ingest information from APIs, message brokers, file systems, sockets, sensors and other enterprise data sources.
• Develop and support event-driven and streaming data services using enterprise messaging and integration platforms.
• Design and implement integrations between enterprise platforms, message brokers, APIs, databases, geospatial applications and external data providers.
• Design and implement mechanisms for secure dissemination of data through APIs, message brokers, file-based exchange and other operational interfaces.
• Contribute to the solution design activities, selecting appropriate storage, processing and dissemination approaches for new data sources and requirements.
• Ensure data quality, integrity and availability across platforms.
• Monitor and optimise data pipelines for performance and reliability.
• Troubleshoot and resolve complex data and platform issues.
• Contribute to automation and CI/CD of data services.
• Collaborate with stakeholders to understand and deliver data requirements.
• Produce technical documentation, runbooks and operational artefacts.

What We Are Looking For

Essential

• Experience engineering and supporting data services within on-premise or self-managed hosting environments, with an understanding of the underlying infrastructure and platform dependencies.
• Experience building and maintaining data pipelines.
• Experience diagnosing and resolving issues in operational production services.
• Strong Python and SQL skills.
• Experience working with structured data and databases.
• Understanding of event-driven architectures and messaging platforms.
• Understanding of data modelling and transformation techniques.
• Experience with Linux environments.
• Strong problem-solving and analytical skills.
• Ability to work independently within defined standards.
• Ability to learn and apply unfamiliar technologies to solve engineering problems.

Desirable

• Experience with container orchestration tools or enterprise data platform technologies.
• Experience with streaming and messaging platforms such as Apache Kafka.
• Experience with CI/CD pipelines, infrastructure automation and DevOps working practices.
• Experience developing or supporting containerised applications within Kubernetes environments.
• Experience with enterprise GIS platforms and geospatial data technologies (e.g. ESRI ArcGIS Enterprise, GeoEvent, Velocity, spatial databases).
• Experience integrating enterprise platforms using REST APIs and automation.
• Experience working with object storage platforms and S3-compatible interfaces.
• Experience in secure or regulated environments.
• Experience implementing data exchange solutions across security domains or controlled information environments.
• Familiarity with service management tools (e.g. Jira, Confluence).