Senior Data Engineer

Ocean Infinity; Porto; Presencial; EUR 60 000 - 99 000; Tempo integral

Resumo da oferta

Ocean Infinity is seeking an experienced Senior Data Engineer to build scalable data pipelines and production-grade data infrastructure that powers analytics and AI initiatives. You will deliver robust data systems across data, product, and engineering teams, driving reliability and automation at scale.

The role emphasizes data quality, collaboration with analysts and engineers, and implementing end-to-end pipelines in cloud environments. Salary up to £85,000; multiple regional locations.

Qualificações

• 5+ years of experience as a Data Engineer, Backend Engineer, or similar in data-intensive systems.
• Strong Python and SQL skills with production-grade pipelines.
• Experience building and maintaining cloud-based data platforms and data lakes.
• Proficiency with distributed systems and data processing at scale.
• Familiarity with Docker and modern CI/CD for data workflows.

Responsabilidades

• Develop scalable data pipelines that automate manual data processes and improve reliability.
• Build end-to-end data transformation workflows (Bronze → Silver → Gold).
• Design Python-based data processing solutions for ingestion, transformation, and delivery.
• Implement data integration across databases, external APIs, and event streams (batch and near-real-time).
• Develop data quality checks, validation, and testing frameworks for data products.
• Build backend data services and lightweight APIs exposing curated datasets.
• Collaborate with analysts, product teams, and AI engineers to translate data needs into production-ready implementations.
• Optimize pipelines for performance, reliability, and maintainability with automation.

Conhecimentos

Python

SQL

Distributed systems

Data pipelines

Formação académica

Bachelor's degree in Computer Science or related field

Ferramentas

Docker

Airflow

Prefect

AWS

GCP

Azure

Descrição da oferta de emprego

Worker TypeEmployee

We are using and creating technology to transform operations at sea to enable people and the planet to thrive. We are open-minded and fearless in our approach to innovation and don’t believe in boundaries. We challenge everything and have massive ambitions to drag aging industries into the tech era. We take safety, equality and education very seriously, and our responsibilities don’t stop at our front door. Our business is built on the belief that there’s definitely a more environmentally responsible way to operate at sea. We employ people who share our core values. We expect our people to be courageous, trustworthy, and conscientious, driven by a desire to do the right thing. We strive for excellence, work collaboratively, and are genuinely excited by our work. We offer opportunities for our people to develop beyond their role and span a multitude of disciplines. These are open to all, regardless of background and experience level. Working with us means being part of a team that is harnessing technology and creativity to disrupt a traditional industry. We are not your average workplace. Ocean Infinity is seeking an experienced and technically accomplished Senior Data Engineer to join our team. The successful candidate will focus on building and implementing scalable data pipelines and automation solutions that transform complex manual workflows into reliable, production-grade data systems. You will play a key role in delivering robust, production-ready data infrastructure, working across data, product, and engineering teams to establish engineering standards and provide high-quality curated datasets that power analytics, operational systems, and AI initiatives across the company.

What Will You Do

• Develop and implement scalable data pipelines that automate manual data processes and improve reliability and efficiency across the organization.
• Build and maintain end-to-end data transformation workflows (Bronze → Silver → Gold), focusing on implementing business logic, data validation, and reusable transformation components.
• Design and develop robust Python-based data processing solutions, including scripts, services, and automation tools that support ingestion, transformation, and data delivery.
• Implement data integration pipelines across a variety of sources, including operational databases, external APIs, and event/streaming data, using both batch and near-real-time approaches.
• Develop and maintain data quality checks, validation rules, and testing frameworks to ensure accuracy, consistency, and reliability of data products.
• Build backend data services and lightweight APIs that expose curated datasets to analytics tools, reporting systems, and downstream applications.
• Collaborate closely with data analysts, product teams, and AI engineers to translate data requirements into efficient, production-ready implementations.
• Optimize and refactor existing pipelines and processes to improve performance, reliability, and maintainability, with a strong focus on code quality and automation.
• Follow and contribute to engineering best practices, including version control standards, modular pipeline design, CI/CD for data workflows, and documentation of implemented solutions.
• Support and mentor other engineers through code reviews, pairing, and sharing practical implementation knowledge and reusable patterns.

Who You Are

• A degree in Computer Science, Mathematics, Engineering, or a related field, or equivalent practical experience.
• 5+ years of experience as a Data Engineer, Backend Engineer, or Software Engineer working with data-intensive systems and production-grade pipelines.
• Strong software engineering skills in Python, with experience building reliable, maintainable data processing code, automation workflows, and backend services.
• Advanced SQL expertise, including query optimization and working with large-scale analytical datasets.
• Strong experience building and maintaining production data pipelines and transformation workflows in distributed and cloud-based environments.
• Strong experience with cloud platforms (e.g., AWS, GCP, or Azure), particularly for building and running data pipelines, storage systems, and compute workloads.
• Strong experience working with data lake and lakehouse environments, including object storage systems (e.g., S3 or equivalent) and structured transformation layers (e.g., Bronze/Silver/Gold patterns).
• Understanding of unstructured and semi-structured data storage patterns (e.g., JSON, logs, event data, files in object storage) and how to process them efficiently at scale.
• Experience with relational and/or NoSQL databases (e.g., Postgres, MongoDB, Redis), including schema design, indexing, and performance optimization.
• Deep experience with containerization technologies such as Docker
• Good understanding of data modelling principles and how to structure datasets for analytics and downstream consumption.
• Exposure to distributed systems concepts and large-scale data processing patterns, with emphasis on practical implementation and debugging.
• Strong problem-solving skills with a focus on reliability, performance, and automation in production systems.
• Ability to collaborate effectively with analysts, product teams, and engineers, translating requirements into robust, testable implementations.
• Experience improving and refactoring existing pipelines and workflows to increase reliability, maintainability, and automation.
• Comfortable working in modern engineering practices including Git-based workflows, code reviews, CI/CD pipelines, and automated testing for data systems.
• Practical experience with workflow orchestration tools such as Airflow, Prefect, or similar, including scheduling, dependency management, retries, and observability.

Desirable

• Strong experience designing and operating data platforms supporting telemetry, sensor, location, and operational technology (OT) data workloads.
• Experience processing and managing large-scale video, image, and unstructured media datasets, including streaming ingestion and analytics workflows.
• Understanding of feature engineering patterns and data preparation workflows supporting machine learning systems.
• Experience working with maritime, fleet, vessel operations, logistics, or industrial operational domains, including telematics, tracking, asset monitoring, or operational analytics use cases.

Salary for this position: Up to £85,000 per annum

Salary: The salary varies for this position as we are recruiting in multiple regional locations and job grades. The salary process is based on skills, abilities, and experience required.

What You Can Expect

At Ocean Infinity, we believe in creating equal opportunities for all, celebrating each and everyone’s differences. We are driven by transforming the industry, through our technology, thoughts, behaviours and actions. Being inclusive and respectful to all is fundamental to who we are. It is the right thing to do and enables innovation and creativity to thrive.

There is more work to be done, and we know that we aren’t perfect, but our commitment to these values is unwavering. They are central to our mission and the impact we have on the industry, meaning, we cannot live without them.