Lead / Senior Software Engineer- Python

Vortexa

Greater London

Hybrid

GBP 45,000 - 75,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Private Health Insurance

Flexible working policy

Equity options

Global Volunteering Policy

Job summary

A fast-growing technology company in the United Kingdom is looking for a mid-senior level data engineer. The role involves designing and building data pipelines using Python, ensuring uptime and fault tolerance. Candidates should have expertise in distributed systems and a passion for continuous learning. The position offers a flexible working policy, private health insurance, and opportunities for equity options in the company.

Qualifications

Fluent in Python and software engineering fundamentals.
Strong expertise in distributed systems and scalable data processing.
Experience in building distributed backend systems handling terabytes of data.

Responsibilities

Design and build infrastructure for data pipelines and ML models.
Collaborate with engineers and data scientists.
Ensure uptime and fault tolerance of data pipelines.

Skills

Python

Distributed systems

Micro-service architectures

Scalable data processing libraries

Backend systems

Software development life cycle

Tools

AWS

Apache Kafka

Kubernetes

Airflow

Job description

3 weeks ago Be among the first 25 applicants

Vortexa is a fast‑growing international technology business founded to solve the immense information gap that exists in the energy industry. By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real‑time, bringing transparency and efficiency to the energy markets and society as a whole.

http://www.vortexa.com/

Processing thousands of rich data points per second from many vastly different external sources, moving terabytes of data while processing it in real‑time, running complex prediction and forecasting AI models while coupling their output into a hybrid human‑machine data refinement process and presenting the result through a nimble low‑latency SaaS solution used by customers around the globe is no small feat of science and engineering. This processing requires models that can survive the scrutiny of industry experts, data analysts and traders, with the performance, stability, latency and agility a fast‑moving startup influencing multi‑$m transactions requires.

The Data Platform Team is responsible for all of Vortexa’s data. The team’s ownership ranges from raw satellite AIS/imaging data to unstructured textual and graphical maritime data like fixtures, port lineups, and customs filings. The team is also responsible for highly structured datasets such as price and supply‑demand forecasts as well as modelling the global energy flows and tanker fleet distributions.

The team has built a variety of procedural, statistical and machine‑learning models that enabled us to provide the most accurate and comprehensive view of energy flows. We take pride in applying cutting‑edge research to real‑world problems in a robust, long‑lasting and maintainable way. The quality of our data is continuously benchmarked and assessed by experienced in‑house market and data analysts to ensure the quality of our predictions.

You’ll be instrumental in designing and building infrastructure and applications to propel the design, deployment, and benchmarking of existing and new pipelines and ML models. Working with software and data engineers, data scientists and market analysts, you’ll help bridge the gap between scientific experiments and commercial products by ensuring 100% uptime and bulletproof fault‑tolerance of every component of the team’s data pipelines.

Requirements

Fluent in Python and software engineering fundamentals, and comfortable with highly scalable data processing libraries
Strong expertise in distributed systems, micro‑service architectures and scalable data processing pipelines
Driven by working in an intellectually engaging environment with the top minds in the industry, where constructive and friendly challenges and debates are encouraged, not avoided
Excited about working in a start‑up environment: not afraid of challenges, excited to bring new ideas to production, and a positive can‑do will‑do person, not afraid to push the boundaries of your job role
Experienced in building distributed heavy‑load backend systems that can go through terabytes of data daily
Passionate about coaching developers, helping them improve their skills and grow their careers
Deep experience of the full software development life cycle (SDLC), including technical design, coding standards, code review, source control, build, test, deploy, and operations

Awesome If You

Are experienced in Rust / Java / Kotlin
Have experience with AWS, Apache Kafka, Kafka Streams, Apache Beam / Flink / Spark - especially deployment, monitoring & debugging
Have experience with productisation of Machine Learning research projects
Are familiar with Airflow or other workflow orchestration tools, and worked with Kubernetes
Understand data lake systems and file formats like Parquet, Orc, Athena
Have some relevant AWS or Kafka certifications

Benefits

A vibrant, diverse company pushing ourselves and the technology to deliver beyond the cutting edge
A team of motivated characters and top minds striving to be the best at what we do at all times
Constantly learning and exploring new tools and technologies
Acting as company owners (all Vortexa staff have equity options)- in a business‑savvy and responsible way
Motivated by being collaborative, working and achieving together
A flexible working policy- accommodating both remote & home working, with regular staff events
Private Health Insurance offered via Vitality to help you look after your physical health
Global Volunteering Policy to help you ‘do good' and feel better

Seniority level