Senior Data Engineer

alpaca

United States

Remote

USD 150,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health Benefits
Stock Options
Home-Office Setup grant

Job summary

Alpaca is seeking a Senior Data Engineer to design and scale the next generation of our Data Platform on GCP for high-volume financial data. You will own lakehouse infrastructure, streaming pipelines, and BI data provisioning to internal and external stakeholders.

You will work in a fully remote, distributed team, use open-source stack with Kubernetes, Terraform, Airflow, Iceberg, and Kafka, and collaborate across DevOps and Analytics teams to deliver reliable data services for hundreds of

Qualifications

  • 5+ years in Data Engineering, building scalable, low-latency data platforms handling >100M events/day.
  • Strong experience running data infra on Kubernetes with Docker/Helm.
  • Production IaC with Terraform/Ansible and ArgoCD or equivalents.
  • Deep knowledge of distributed systems and open-source engines (Trino/Presto).
  • Strong SQL and Python for pipelines and tooling.
  • Experience with GCP data services (GCS, Cloud Build, Cloud SQL, Dataproc).
  • Ability to thrive in a fast-paced startup and adapt infra quickly.

Responsibilities

  • Design, build, and evolve core data platform infra (query engines, orchestration, warehousing, cataloging).
  • Own lakehouse infra as code; deployments with Terraform and Ansible on Kubernetes.
  • Build and scale low-latency streaming and CDC ingestion paths and batch paths to Iceberg.
  • Develop and scale BI data access for downstream teams and agents.
  • Enforce reliability: monitoring, on-call rotations, runbooks, SLAs; partner with DevOps/Analytics.

Skills

Distributed data platform
Kubernetes
Python
SQL
Data warehousing
Cloud data services
Open-source stack
Terraform
Ansible
Airflow
Iceberg
Kafka
Debezium
GCP

Tools

Kubernetes
Terraform
Ansible
Airflow
Iceberg
Kafka
Debezium
OpenMetadata/Datahub
dbt Looker

Job description

Who We Are:

Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more.

Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.

Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We’re deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.

Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.

Our Team Members:

We’re a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond!

We’re searching for passionate individuals eager to contribute to Alpaca’s rapid growth. If you align with our core values-Stay Curious, Have Empathy, and Be Accountable-and are ready to make a significant impact,

Your Role:

We are seeking a Senior Data Engineer to help design and build the next generation of our Data Platform as we continue to scale to larger customers and new jurisdictions. At Alpaca, Data Engineering encompasses financial transactions, customer data, API logs, system metrics, augmented data, and third-party systems that impact decision making for both internal and external stakeholders. We process hundreds of millions of events daily, and this number continues to grow as we onboard new customers and products.

We prioritize open-source technologies in our data stack while leveraging Google Cloud Platform (GCP) as the foundation for our data infrastructure. This spans batch and stream ingestion, transformation, and consumption layers for BI/Reporting, AI/agent interfaces (MCP), and external third-party sinks. We also oversee data experimentation, cataloging, and monitoring/alerting systems.

Our team is 100% distributed and remote.

Responsibilities:
  • Design, build, and evolve the core data platform infrastructure e.g., distributed query engines, orchestration, warehousing, cataloging, and more.
  • Own our lakehouse infrastructure as code, managing deployments through Terraform and Ansible on Kubernetes.
  • Build and maintain low-latency streaming and CDC ingestion pipelines, as well as batch ingestion paths landing in Iceberg.
  • Develop and scale our BI landscape so downstream teams and agents get performant, self-serve access to lakehouse data.
  • Enforce platform reliability best practices, including monitoring and alerting, on-call rotations, incident response, maintenance windows, runbooks, and SLAs.
  • Partner with DevOps, Analytics Engineering, and other stakeholders to close infrastructure gaps and support new data requirements.
Must-Haves:
  • 5+ years of experience in Data Engineering, including 2+ years building and operating scalable, low-latency data platforms handling > 100M events/day.
  • Strong hands-on experience running data infrastructure on Kubernetes, with cloud-native tooling like Docker and Helm.
  • Production experience with IaC: Terraform, Ansible, and ArgoCD (or equivalents).
  • Deep knowledge of distributed systems (storage, transactions, and query processing) with hands-on experience operating open-source query engines like Trino or Presto.
  • Strong experience with object storage and open table formats, specifically Apache Iceberg.
  • Experience with streaming and CDC systems: Kafka, Redpanda, and Debezium.
  • Hands-on experience with orchestration frameworks (Airflow) and ELT tools (Airbyte).
  • Strong working knowledge of Python and SQL for building pipelines and platform tooling.
  • Experience with Google Cloud Platform and its data services (GCS, Cloud Build, Cloud SQL, Dataproc, etc); or related experience with other cloud services.
  • Ability to thrive in a fast-paced startup environment and adapt infrastructure to rapidly changing needs.
Nice to Haves:
  • Experience with semantic/metrics layers (Cube, dbt, Looker).
  • Familiarity with transformation frameworks (dbt).
  • Familiarity with reverse ETL tooling (Hightouch)
  • Familiarity with data catalog and lineage tooling (OpenMetadata, Datahub)
  • Experience with data access control and governance frameworks (Apache Ranger)
How We Take Care of You:
  • Competitive Salary & Stock Options
  • Health Benefits
  • New Hire Home-Office Setup: One-time USD $500
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Platform Engineer
Senior Data Platform Engineer

Alpaca • United States

Remote
USD 140,000 - 190,000
Stock options
Health benefits
One-time USD 500 home-office setup
+1
Senior Data Platform Engineer
Senior Data Platform Engineer

Alpaca • United States

Remote
USD 150,000 - 190,000
Health Benefits
New Hire Home-Office Setup: One-time $
Monthly Stipend: $150 per month
Senior Data Platform Engineer
Senior Data Platform Engineer

Alpaca • United States

Remote
USD 180,000 - 240,000
Stock options
Health benefits
One-time USD 500 home-office setup
+1
Senior Data Platform Engineer
Senior Data Platform Engineer

Alpaca • New York (NY)

Remote
USD 180,000 - 240,000
Health Benefits
New Hire Home-Office Setup: USD $500
Monthly Stipend: USD $150 per month
Remote Analytics Engineer - Data Transformation & Modeling
Remote Analytics Engineer - Data Transformation & Modeling

Social Leverage LLC • New Jersey

Hybrid
USD 120,000 - 180,000
Stock options
Home-office setup USD 500
Monthly stipend USD 150
Senior Software Engineer - Market Data
Senior Software Engineer - Market Data

Alpaca • United States

Remote
USD 160,000 - 230,000
Competitive salary
Stock options
Home-office setup $500
+1
Staff Analytics Engineer
Staff Analytics Engineer

Social Leverage LLC • New Jersey

Hybrid
USD 120,000 - 180,000
Stock options
Home-office setup USD 500
Monthly stipend USD 150
Senior Software Engineer - Market Data
Senior Software Engineer - Market Data

Social Leverage LLC • United States

Hybrid
USD 140,000 - 180,000
Stock options
Home-office setup
Brex card stipend
Senior Software Engineer - Low-Latency Market Data
Senior Software Engineer - Low-Latency Market Data

Social Leverage LLC • United States

Hybrid
USD 140,000 - 180,000
Stock options
Home-office setup
Brex card stipend
Senior Software Engineer - Market Data
Senior Software Engineer - Market Data

Social Leverage • New Jersey

Remote
USD 140,000 - 210,000
Home-Office setup
Monthly stipend