Remote Senior Data Platform Engineer - Petabyte-Scale

Crypto Pro Network; United States; Remote; USD 190,000 - 220,000; Full time

Job summary

A leading blockchain intelligence firm is seeking a Senior Software Engineer to join the Data Platform team. In this role, you will design and implement scalable data infrastructure, develop ETL pipelines, and ensure high availability of data services. The ideal candidate has over 5 years of experience in distributed system architecture, strong Python programming skills, and a Bachelor's degree in Computer Science. This position offers competitive compensation and remote working flexibility.

Qualifications

• 5+ years of experience in architecting distributed system architecture.
• Proven ability in loading, querying, and transforming extensive datasets.
• Exceptional programming skills in Python.

Responsibilities

• Build reliable data services to integrate with blockchains.
• Develop ETL pipelines for processing petabytes of data.
• Design data models for optimal storage and retrieval.

Skills

Python

SQL

SparkSQL

Data Engineering

ETL Pipelines

Docker

Kubernetes

Terraform

Kafka

Data Processing

Education

Bachelor's degree in Computer Science or related field

Tools

Airflow

DBT

Iceberg

Trino

BigQuery

StarRocks

Citus

Job description

A leading blockchain intelligence firm is seeking a Senior Software Engineer to join the Data Platform team. In this role, you will design and implement scalable data infrastructure, develop ETL pipelines, and ensure high availability of data services. The ideal candidate has over 5 years of experience in distributed system architecture, strong Python programming skills, and a Bachelor's degree in Computer Science. This position offers competitive compensation and remote working flexibility.