Remote Data Platform Engineer: Lakehouse & Streaming

Diagram; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Stock options

Health benefits

New hire home-office setup: USD 500

Monthly Brex card stipend: USD 150

Job summary

Alpaca, a US-headquartered leader in brokered infrastructure, seeks a Data Platform Engineer to design and operate the data platform powering transactions, analytics, and developer APIs. You will own projects from implementation to production in a 100% remote, distributed environment.

The role requires 4+ years building scalable data platforms, strong Python/SQL skills, and experience with Kubernetes, Terraform, and streaming/CDC tech creating robust, observable data services.

Qualifications

• 4+ years of experience building and operating large-scale data platforms.
• Proficiency in Python and SQL for data pipelines and tooling.
• Experience with distributed systems, cloud data infrastructure, and CI/CD for data workloads.

Responsibilities

• Design and operate core data platform components, including lakehouse storage and metadata cataloging.
• Manage lakehouse deployment workflows with IaC tools like Terraform and Ansible on Kubernetes.
• Build scalable streaming and CDC pipelines with Kafka/Redpanda and Debezium.
• Develop serving and BI infrastructure enabling self-service access to data.
• Ensure reliability via observability, on-call practices, and incident response.

Skills

Distributed systems

Python

SQL

Data pipelines

Observability & SRE

Production ownership

Tools

Terraform

Ansible

Kubernetes

Helm

Argo CD

Airflow

Airbyte

Kafka

Iceberg

Job description

Alpaca, a US-headquartered leader in brokered infrastructure, seeks a Data Platform Engineer to design and operate the data platform powering transactions, analytics, and developer APIs. You will own projects from implementation to production in a 100% remote, distributed environment.

The role requires 4+ years building scalable data platforms, strong Python/SQL skills, and experience with Kubernetes, Terraform, and streaming/CDC tech creating robust, observable data services.