Data Engineer

Ocean Infinity; Greater London; On-site; GBP 60,000 - 90,000; Full time

Job summary

Ocean Infinity is seeking a Data Engineer to build scalable data pipelines and automation that convert complex workflows into robust, production-grade data systems. You’ll work across data, product, and engineering teams to deliver curated datasets powering analytics and AI initiatives.

The role focuses on transforming data using Bronze/Silver/Gold patterns, implementing robust Python data processing, and contributing to back-end data services and APIs for analytics and reporting.

Qualifications

• A degree in Computer Science, Mathematics, Engineering, or related field, or equivalent practical experience.
• Minimum 2 years of experience as a Data Engineer or related role with data pipelines.

Responsibilities

• Develop scalable data pipelines and automation to transform manual workflows into robust data systems.
• Build end-to-end data transformations and reusable components (Bronze/Silver/Gold).
• Develop Python-based data processing solutions and APIs for data delivery.
• Implement data integration from databases, APIs, and streaming data using batch and near real-time approaches.
• Maintain data quality checks, validation, and testing for data products.
• Collaborate with analysts, product teams, and AI engineers to translate requirements into production-ready implementations.
• Improve pipelines for reliability, performance, and automation and follow CI/CD practices.

Skills

Python

SQL

Cloud platforms

Data pipelines

CI/CD

Docker

API development

Data modeling

Education

Bachelor's degree in CS/Math/Engineering

Tools

PostgreSQL

MongoDB

S3 / object storage

Git

Job description

At Ocean Infinity , we're on a bold mission to subsea data using innovative technology. Using cutting-edge robotics, autonomous technology and world-class software, we're transforming how complex operations are carried out at sea. Our uncrewed systems are making ocean exploration and operations safer, smarter and more sustainable , helping unlock the vast potential of our oceans while reducing environmental impact. This isn't a vision for the future. It's happening right now. As we continue to push the boundaries of innovation and redefine what's possible in the maritime industry, we're looking for exceptional talent to join our fast-growing team.

Ocean Infinity is seeking a motivated and technically capable Data Engineer to join our team. The successful candidate will focus on building and implementing scalable data pipelines and automation solutions that transform complex manual workflows into reliable, production-grade data systems. You will contribute to delivering robust, production-ready data infrastructure, working across data, product, and engineering teams to apply engineering standards and provide high-quality curated datasets that power analytics, operational systems, and AI initiatives across the company.

What you will do!

• Develop and implement scalable data pipelines that automate manual data processes and improve reliability and efficiency across the organization.
• Build and maintain end-to-end data transformation workflows (Bronze Silver Gold), focusing on implementing business logic, data validation, and reusable transformation components.
• Develop robust Python-based data processing solutions, including scripts, services, and automation tools that support ingestion, transformation, and data delivery.
• Implement data integration pipelines across a variety of sources, including operational databases, external APIs, and event/streaming data, using both batch and near-real-time approaches.
• Develop and maintain data quality checks, validation rules, and testing frameworks to ensure accuracy, consistency, and reliability of data products.
• Build backend data services and lightweight APIs that expose curated datasets to analytics tools, reporting systems, and downstream applications.
• Collaborate closely with data analysts, product teams, and AI engineers to translate data requirements into efficient, production-ready implementations.
• Optimize and refactor existing pipelines and processes to improve performance, reliability, and maintainability, with a strong focus on code quality and automation.
• Follow and contribute to engineering best practices, including version control standards, modular pipeline design, CI/CD for data workflows, and documentation of implemented solutions.
• Participate in code reviews and pairing, learning from more experienced engineers and sharing implementation knowledge and reusable patterns with the team.

What we look for!

• A degree in Computer Science, Mathematics, Engineering, or a related field, or equivalent practical experience.
• Minimum 2 years of experience as a Data Engineer, Backend Engineer, or Software Engineer working with data-intensive systems and data pipelines.
• Solid software engineering skills in Python, with experience writing reliable, maintainable data processing code and automation workflows.
• Good SQL skills, with an understanding of query optimization and working with analytical datasets.
• Experience building and maintaining data pipelines and transformation workflows, ideally in cloud-based environments.
• Hands-on experience with at least one cloud platform (e.g., AWS, GCP, or Azure), particularly for building and running data pipelines, storage systems, and compute workloads.
• Familiarity with data lake and lakehouse environments, including object storage systems (e.g., S3 or equivalent) and structured transformation layers (e.g., Bronze/Silver/Gold patterns).
• Understanding of unstructured and semi-structured data storage patterns (e.g., JSON, logs, event data, files in object storage) and how to process them efficiently.
• Experience with relational and/or NoSQL databases (e.g., Postgres, MongoDB, Redis), including schema design and indexing.
• Working knowledge of containerization technologies such as Docker.
• Good understanding of data modelling principles and how to structure datasets for analytics and downstream consumption.
• Exposure to distributed systems concepts and large-scale data processing patterns, with emphasis on practical implementation and debugging.
• Strong problem-solving skills with a focus on reliability, performance, and automation in production systems.
• Ability to collaborate effectively with analysts, product teams, and engineers, translating requirements into robust, testable implementations.
• Interest in improving and refactoring existing pipelines and workflows to increase reliability, maintainability, and automation.
• Comfortable working in modern engineering practices including Git-based workflows, code reviews, CI/CD pipelin