Data Engineer - DeFi

Crypto Recruit; City Of London; On-site; GBP 50,000 - 80,000; Full time

Job summary

A leading cryptocurrency recruitment firm is looking for a Data Pipeline Engineer in London. In this role, you'll design and implement data pipeline platforms that optimize customer experiences. You'll collaborate with senior engineers on foundational data infrastructure while working in a fast-paced environment. Ideal candidates will have strong experience in data modeling, SQL, and scripting languages, along with a passion for the cryptocurrency industry.

Qualifications

• Experience with data modeling, warehousing, and building data pipelines.
• Experience in SQL and developing a time-series database.
• Knowledge of distributed systems for data storage and computing.
• Strong communication skills with technical and non-technical stakeholders.
• 4+ years of engineering experience is required.

Responsibilities

• Build and support a data pipeline platform for customer behavioral data.
• Evaluate technical approaches and drive consensus with engineering peers.
• Ensure data access for the Core Engineering/Product team.
• Participate in open-source development with external teams.

Skills

Data modeling

Data warehousing

Building data pipelines

SQL

Python

NodeJS

Distributed systems

Restful APIs

Agile methodologies

Curiosity about new trends

Tools

Kafka

Hadoop

MySQL

Cassandra

Job description

As a Data Pipeline Engineer, you would have a hand in the design, implementation, deployment, and support of our company's Data Service project. As a member of the Data Service team, you will work on foundational data infrastructure.

You’d optimize the company's external visibility and assist various 3rd party sources to leverage our Data Service. You’d help architect real-time microservices that capture the company's blockchain events and build systems that provide support to our external API services where users can monitor network health and other various analytics over time.

As a company team member, you would be responsible for creating technically viable software with a team of senior engineers specializing in DevOps, distributed systems, system architecture, testing, and other related fields. You would be collaborating with some of the most diligent minds in the cryptocurrency industry on product direction, both on the core company team and among its partners, investors, and advisors. As an early team member, you must feel comfortable working in a fast-paced environment where the solutions aren’t already predefined.

Prior experience with blockchain projects is helpful but we are primarily interested in the capacity to grow into the role. You should have prior experience in developing high-quality backend architecture and some passing knowledge of how such architecture principles should apply to blockchain data services.

We are looking for individuals who are passionate about being at the forefront of a new technological paradigm and can lead the design and development of scalable applications.

Requirements

• Build and support a data pipeline platform that allows a customer's behavioral data to directly impact their individualized experiences on the company.
• Learn to evaluate multiple technical approaches and drive consensus with your engineering peers
• Use data to solve real-world problems and assist both internal and external partners with data integrations
• You will be responsible for ensuring access to data and tooling for the Core Engineering / Product team to leverage for direct customer use
• Developing sound testing and debugging practices
• Creating technical documentation and well-commented code for open-source consumption
• Participating in open source development on shared resources with external development teams

Qualifications

• Experience with data modeling, data warehousing, and building data pipelines
• Experience in SQL and building a time-series database (Postgres)
• Knowledge of data management fundamentals and data storage principles
• Knowledge of distributed systems as it pertains to data storage and computing
• Proficiency in, at least, one modern scripting or programming language such as Python, NodeJS
• Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
• Strong understanding of distributed systems and Restful APIs.
• You’re opinionated about tooling and curious about new trends and technologies in the software development world.
• Independence and self-motivation
• 4+ years of engineering experience

Bonus Points

• Data Processing - experience with building and maintaining large scale and / or real-time complex data processing pipelines using Kafka, Hadoop, Hive, Storm, or Zookeeper
• Experience with large-scale distributed storage and database systems (SQL or NoSQL, e.g. MySQL, Cassandra)
• Background in academic economics or finance
• Familiarity with Cosmos, Tendermint, or Thorchain
• Familiarity with the Rust / Golang programming language
• Experience in small startup environments
• Experience with a distributed team / remote work