Remote Senior Data Platform Engineer: Scale Pipelines

Unchain Data; San Francisco, Northern (CA, KY); Hybrid; USD 220,000 - 265,000; Full time

Benefits offered by this job

Medical, dental & vision insurance

Work from home flexibility

Unlimited PTO

Commuter benefits

Free lunches

Paid parental leave

401(k)

Employee assistance program

Job summary

Parafin is seeking a Senior Software Engineer to join the Infrastructure team and lead the Data Platform development. You will design, build, and maintain data ingestion, transformation, and serving systems across the company, partnering with Data Science and Product Engineering to power data-driven product decisions.

You will own core data pipelines, optimize lakehouse infrastructure, and mentor engineers. This role offers remote work flexibility, competitive equity, and comprehensive benefits.

Qualifications

• 4+ years of software engineering with data infrastructure and distributed systems.
• Strong Python and SQL proficiency with hands-on Spark experience.
• Experience with modern cloud data stacks (AWS, Databricks, Airflow).
• Familiarity with data-versioning, lineage, partitioning, and data lakehouse concepts.

Responsibilities

• Design and build scalable data pipelines and lakehouse infrastructure on AWS using PySpark, Databricks, and Airflow.
• Improve data platform experience with self-service tooling and clear documentation.
• Own data pipelines and models powering dashboards, ML models, and customer-facing products.
• Manage Databricks workspaces, access, performance, and high availability of pipelines.
• Lead data quality, testing, observability, and cost optimization initiatives.
• Collaborate with Data Science and Product Engineering to enable data-driven decisions.

Skills

Python

SQL

Spark

AWS

Databricks

Airflow

Hadoop

Kafka

Tools

Terraform

Databricks

Trino/Presto

Job description

Parafin is seeking a Senior Software Engineer to join the Infrastructure team and lead the Data Platform development. You will design, build, and maintain data ingestion, transformation, and serving systems across the company, partnering with Data Science and Product Engineering to power data-driven product decisions.

You will own core data pipelines, optimize lakehouse infrastructure, and mentor engineers. This role offers remote work flexibility, competitive equity, and comprehensive benefits.