Senior Data Engineer, Data Cloud

chainalysis-careers; New York (NY); Hybrid; USD 130,000 - 160,000; Full time

Job summary

Chainalysis, based in New York, is seeking a Senior Data Engineer to join their Data Cloud team. You will play a pivotal role in optimizing their data storage and processing platforms, facilitating high-performance interactive analytics and data applications.

Ideal candidates will have extensive experience with streaming data, AWS services, and building scalable data pipelines. The position offers a collaborative work environment focusing on innovative technologies.

Qualifications

• 6+ years as a Data Engineer or related field with hands-on streaming data.
• Experience in building batch and streaming data pipelines.
• Expertise with cloud architecture and fault-tolerant distributed data systems.

Responsibilities

• Define the technical vision of the team and evolve the data platform.
• Implement and optimize the scalable data serving platform.
• Build seamless integrations between Data Cloud and databases.

Skills

Streaming data expertise

Apache Spark/Flink

AWS services

Data modeling best practices

Cloud architecture

Python or SQL

Tools

Terraform

Databricks

Snowflake

Airflow

Delta/Iceberg

Clickhouse

Job description

The engineering team at Chainalysis is inspired by solving the hardest technical challenges and building products that establish trust in cryptocurrencies. We're a global organization that thrives on challenging work and doing it alongside exceptionally talented teammates. Our industry evolves rapidly, and our mission is to build a flexible, AI-driven platform that automates entity resolution, optimizes data labeling pipelines, and creates predictive models that identify illicit patterns before they escalation.

Our data and solutions have been used to solve some of the world's most high-profile criminal cases and grow consumer access to cryptocurrency safely. Now, by pairing the industry's most trusted blockchain data with agents that reason, investigate, and act, we help our customers scale their workflows as the cryptocurrency economy becomes increasingly mainstream.

We’re looking for a Senior Data Engineer to join our Data Cloud team. This group accelerates innovation & helps unlock new business lines, by empowering anyone at Chainalysis to quickly and reliably discover, access, analyze, and build on top of any and all data. You’ll be a key leader in creating and optimizing our petabyte-scale data storage, data processing, and data querying platforms. If you’re passionate about enabling high-performance interactive analytics, real-time streaming data applications, and deploying cloud infrastructure at scale with enterprise-grade reliability, we want you to join our talented and growing team!

In this role:

• Help define the technical vision of the team/org, articulate how our data platform and architecture could evolve
• Design, implement, and optimize our high-performance, scalable data serving platform that enables data querying and consumption across the organization and external facing data products
• Design, implement, and optimize our high-performance, scalable data storage and transformation platform that enables both batch and stream processing with 100+ million updates per day on datasets > 100 billion rows
• Build seamless integrations between Data Cloud and various relational and noSQL OLTP databases
• Build batch and streaming data pipelines for core blockchain datasets widely used across the company
• Deploy cloud infrastructure at scale with enterprise-grade reliability, implement and maintain infrastructure automation and self-service, and create robust CI/CD pipelines
• Establish and maintain observability, security, and data governance solutions to ensure high quality, efficiency, and reliability of data pipelines

Qualifications

• 6+ years of experience as a Data Engineer or Software Engineer or Infrastructure Engineer, with hands‑on expertise in streaming data at scale.
• Experience in building and maintaining both batch and streaming data pipelines using Apache Spark/Apache Flink, as well as deep understanding of data modeling best practices
• Expertise with AWS services, cloud architecture, fault‑tolerant distributed data systems, and proficiency with Terraform for provisioning and managing cloud infrastructure
• Deep understanding of modern data lakehouse architectures and ecosystem such as Databricks, Snowflake, DBT, Airflow, Debezium, Delta/Iceberg, StarRocks, Clickhouse, and proficient with Python (or similar) and SQL.
• Passion for leading/contributing towards the technical vision of the team/org, strong ownership of mission critical systems, dedication to honing their craft while mentoring others
• Experience building tools and frameworks to accelerate the development of data pipelines, and familiarity with data governance, data quality, and observability best practices

Nice to have Experience

• Exposure to or interest in the cryptocurrency technology ecosystem
• Experience working with different blockchain technologies

Technologies we Use

• Data Lakehouse: Kafka, Flink, Spark, Databricks, DBT, Debezium, StarRocks/Clickhouse
• AWS Services: MSK, EC2, VPC, IAM, S3, SQS, Managed Flink, EKS, etc.

We encourage applicants across any race, ethnicity, gender/gender expression, age, spirituality, ability, experience and more. If you need any accommodations to make our interview process more accessible to you due to a disability, let us know.