Remote Software Engineer - Distributed ML Training - Gensyn

Blockchain Works; City Of London; Remote; GBP 85,000 - 120,000; Full time

Job summary

A leading technology company is seeking an innovative engineer to design and implement machine learning execution systems. You will work remotely, optimizing performance and engaging in novel research within a dynamic, autonomous environment. Ideal candidates possess strong distributed system training experience, networking knowledge, and are eager to learn Rust. This role includes competitive compensation, equity options, and additional benefits such as relocation assistance and paid retreats.

Benefits

Competitive salary and equity

Fully remote work

Relocation assistance

Paid company retreats

Necessary equipment provided

Paid sick leave

Private health insurance

Qualifications

• Experience designing/working with training systems on large clusters.
• Understanding and troubleshooting with networking protocols: IP, TCP, UDP, HTTP.
• Experience with large open source codebases.
• Strong willingness to learn Rust.
• Understanding of computational complexity and algorithms.
• Excellent verbal and written communication skills.
• Comfortable working in an applied research environment.

Responsibilities

• Design/implement system for orchestration of ML execution.
• Performance optimisation of training algorithms.
• Implement novel research mechanisms and algorithms.
• Provide engineering support on ML-related issues.
• Contribute to technical reports/papers and engage with the community.

Skills

Hands-on distributed foundation model training

Networking protocols knowledge

Open source work experience

Willingness to learn Rust

Computer science background

Self-motivated with communication skills

Comfortable in research environments

Education

Computer Science degree

Tools

Rust

Job description

The world will be unrecognisable in 5 years.

Machine learning models are driving our cars, testing our eyesight, detecting our cancer, giving sight to the blind, giving speech to the mute, and dictating what we consume, enjoy, and think. These AI systems are already an integral part of our lives and will shape our future as a species.

Soon, we’ll conjure unlimited content: from never-ending TV series (where we’re the main character) to personalised tutors that are infinitely patient and leave no student behind. We’ll augment our memories with foundation models—individually tailored to us through RLHF and connected directly to our thoughts via Brain-Machine Interfaces—blurring the lines between organic and machine intelligence and ushering in the next generation of human development.

This future demands immense, globally accessible, uncensorable, computational power. Gensyn is the machine learning compute protocol that translates machine learning compute into an always-on commodity resource—outside of centralized control and as ubiquitous as electricity—accelerating AI progress and ensuring that this revolutionary technology is accessible to all of humanity through a free market.

Our Principles:

AUTONOMY

• Don’t ask for permission - we have a constraint culture, not a permission culture.
• Claim ownership of any work stream and set its goals/deadlines, rather than waiting to be assigned work or relying on job specs.
• Push & pull context on your work rather than waiting for information from others and assuming people know what you’re doing.
• No middle managers - we don’t (and will likely never) have middle managers.

FOCUS

• Small team - misalignment and politics scale super-linearly with team size. Small protocol teams rival much larger traditional teams.
• Thin protocol - build and design thinly.
• Reject waste - guard the company’s time, rather than wasting it in meetings without clear purpose/focus, or bikeshedding.

REJECT MEDIOCRITY

• Give direct feedback to everyone immediately rather than avoiding unpopularity, expecting things to improve naturally, or trading short-term pain for extreme long-term pain.
• Embrace an extreme learning rate rather than assuming limits to your ability/knowledge.
• Drive-push areas of ownership to final outcome, despite any barriers.

Responsibilities

👉 Design/implement system for orchestration of ML execution - enable training across our uniquely decentralised and heterogeneous infrastructure.

👉 Performance optimisation - continually profile and optimise our training algorithms

👉 Implement novel research - build out newly proposed mechanisms and algorithms to solve never-tackled-before problems

👉 Engineering support - work with the rest of the team on wider issues concerning ML (e.g. reproducible training)

👉 Write & engage - contribute to technical reports/papers describing the system and discuss with the community

Minimum requirements

✅ Hands‑on distributed foundation model training - experience designing and/or working with training systems on large clusters

✅ Networking - understanding and troubleshooting experience of the most common networking protocols: IP, TCP, UDP, HTTP. As well as experience in communications backends e.g. NCCL, GLOO and MPI.

✅ Open source work - experience working with large open source codebases - either as maintainer or trusted contributor

✅ Strong willingness to learn Rust - as a Rust by default company, we require that everyone learns Rust so that they have context/can work across the entire codebase

✅ Computer science background - understanding of computational complexity (time, space) and broad knowledge of algorithms and data structures

✅ Highly self‑motivated with excellent verbal and written communication skills

✅ Comfortable working in an applied research environment - with extremely high autonomy and unpredictable timelines

Nice to haves

🔥 Rust - strong experience with systems programming in Rust (you know what a 'lifetime' is and understand the purpose of Pin)

🔥 Research background - published research in the distributed systems or ML domains

🔥 Blockchain - understanding of blockchain fundamentals

Compensation / Benefits:

💰 Competitive salary + share of equity and token pool

🌐 Fully remote work - we hire between the West Coast (PT) and Central Europe (CET) time zones

💼 Relocation Assistance - available for those that would like to move to a different location after being hired

🛫 4x all expenses paid company retreats around the world, per year

💻 Whatever equipment you need

❤️ Paid sick leave

🏥 Private health, vision, and dental insurance - including spouse/dependents [🇺🇸 only]