Senior Data Platform Engineer

Alpaca; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive Salary & Stock Options

New Hire Home-Office Setup: One-time $

Monthly Stipend: $150 per month via a

Monthly Stipend: USD $150 per month

Job summary

Alpaca, a US-headquartered brokerage infrastructure leader, is hiring a Data Platform Engineer to build and operate the data platform powering transactions, customer data, and real-time events. You will own projects from implementation through production and work on lakehouse, CDC, and streaming infrastructure.

The team is 100% distributed and remote; you will collaborate with engineers across regions and contribute to impactful platform capabilities that scale to hundreds of millions of events

Qualifications

• 4+ years of experience in software engineering, data infrastructure, or platform engineering.
• Strong knowledge of distributed systems and production experience with query engines such as Trino or Presto.
• Strong experience operating Kubernetes-based data infrastructure using infrastructure-as-code and deployment tools such as Terraform, Helm, Ansible, or Argo CD.
• Experience designing and operating compute platforms across multiple cloud regions, balancing workload locality, peak and bursty demand, resource isolation, workload prioritization, and cost-performance trade-offs.
• Hands-on experience designing and operating cloud lakehouse architectures on GCP, AWS, or Azure, including object storage, metastores, and open table formats, particularly Apache Iceberg.
• Experience operating large-scale streaming and CDC systems using technologies such as Kafka, Redpanda, and Debezium.
• Strong Python and SQL skills, with experience building reliable data pipelines and platform tooling using orchestration and ingestion frameworks such as Airflow and Airbyte.

Responsibilities

• Design, develop, and evolve Alpaca’s core data platform, including distributed query engines, orchestration, lakehouse storage, metadata, and cataloging.
• Own our lakehouse infrastructure as code, building reliable and repeatable deployment workflows with Terraform and Ansible on Kubernetes.
• Build and operate scalable, low-latency streaming and CDC pipelines alongside dependable batch ingestion paths into Apache Iceberg.
• Develop and scale our serving and BI infrastructure, giving downstream teams and agents performant, governed, self-service access to lakehouse data.
• Take end-to-end ownership of platform reliability through observability, actionable alerting, on-call practices, incident response, maintenance procedures, runbooks, and service-level objectives.
• Partner with DevOps, Analytics Engineering, and stakeholders across Alpaca to close infrastructure gaps, shape technical requirements, and deliver reusable platform capabilities.

Skills

Distributed systems

Python

SQL

Kubernetes

Data pipelines

Observability

Tools

Trino/Presto

Terraform

Helm

Ansible

Argo CD

Airflow

Airbyte

Apache Iceberg

Kafka

Redpanda

Debezium

Job description

Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more.

Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.

Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We're deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.

Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.

We're a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond! We're searching for passionate individuals eager to contribute to Alpaca's rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

About the team & role

The Data Platform team builds and operates the shared infrastructure that powers how data is stored, moved, and consumed across Alpaca. Our platform supports financial transactions, customer data, API and system events, enriched datasets, and third‑party sources that power critical decisions and products for internal teams and external stakeholders. We process hundreds of millions of events each day and that scale continues to grow as Alpaca serves more customers and launches new products.

As a Data Platform Engineer, you will build and operate reliable systems across Alpaca’s data platform. You’ll contribute to our distributed query, lakehouse, CDC, and real‑time streaming infrastructure while collaborating with experienced engineers and partner teams. You’ll own projects from implementation through production operation and help improve the platform’s scalability, reliability, and developer experience.

Our team is 100% distributed and remote.

Responsibilities:

• Design, develop, and evolve Alpaca’s core data platform, including distributed query engines, orchestration, lakehouse storage, metadata, and cataloging.
• Own our lakehouse infrastructure as code, building reliable and repeatable deployment workflows with Terraform and Ansible on Kubernetes.
• Build and operate scalable, low‑latency streaming and CDC pipelines alongside dependable batch ingestion paths into Apache Iceberg.
• Develop and scale our serving and BI infrastructure, giving downstream teams and agents performant, governed, self‑service access to lakehouse data.
• Take end‑to‑end ownership of platform reliability through observability, actionable alerting, on‑call practices, incident response, maintenance procedures, runbooks, and service‑level objectives.
• Partner with DevOps, Analytics Engineering, and stakeholders across Alpaca to close infrastructure gaps, shape technical requirements, and deliver reusable platform capabilities.

Must-Haves:

• 4+ years of experience in software engineering, data infrastructure, or platform engineering, with demonstrated ownership of complex production systems and technical projects.
• Strong understanding of distributed systems and production experience with query engines such as Trino or Presto.
• Strong experience operating Kubernetes‑based data infrastructure using infrastructure‑as‑code and deployment tools such as Terraform, Helm, Ansible, or Argo CD.
• Experience designing and operating compute platforms across multiple cloud regions, balancing workload locality, peak and bursty demand, resource isolation, workload prioritization, and cost‑performance trade‑offs.
• Hands‑on experience designing and operating cloud lakehouse architectures on GCP, AWS, or Azure, including object storage, metastores, and open table formats, particularly Apache Iceberg.
• Experience operating large‑scale streaming and CDC systems using technologies such as Kafka, Redpanda, and Debezium.
• Strong Python and SQL skills, with experience building reliable data pipelines and platform tooling using orchestration and ingestion frameworks such as Airflow and Airbyte.
• Strong operational judgment and the ability to make sound technical decisions, communicate trade‑offs, and work effectively through ambiguity.

Nice to Haves:

• Experience with semantic or metrics layers such as Cube, dbt, or Looker.
• Experience deploying and operating infrastructure for AI agents.
• Experience building or integrating context layers that connect structured and unstructured organizational data.
• Experience with data governance and access‑control frameworks such as Apache Ranger.

How We Take Care of You:

• Competitive Salary & Stock Options
• New Hire Home‑Office Setup: One-time USD $500
• Monthly Stipend: USD $150 per month via a Brex Card

Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

As set forth in Alpaca ’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service‑connected disability.

A "recently separated veteran" means any veteran during the three‑year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.