Data Platform Engineer

Alpaca; United States; À distance; USD 150 000 - 210 000; Plein temps

Avantages offerts par ce poste

Competitive Salary & Stock Options

Health Benefits

New Hire Home-Office Setup: USD 500

Monthly Stipend: USD 150 via Brex Card

Résumé du poste

Alpaca is a US-headquartered, distributed company building a data platform that powers data storage, movement, and access across a scalable lakehouse architecture. As a Data Platform Engineer, you’ll own and operate core data services, ensure low-latency ingestion, and enable internal teams with governed, self-service data access.

You’ll work on distributed query engines, real-time streaming, and batch pipelines, collaborating with DevOps and analytics partners to drive reliability and

Qualifications

• 4+ years of experience in software engineering, data infrastructure, or platform engineering.
• Strong understanding of distributed systems and production experience with query engines such as Trino or Presto.
• Strong experience operating Kubernetes-based data infrastructure using infrastructure-as-code and deployment tools such as Terraform, Helm, Ansible, or Argo CD.
• Experience designing and operating compute platforms across multiple cloud regions, balancing workload locality and cost-performance trade-offs.
• Hands-on experience designing and operating cloud lakehouse architectures on GCP, AWS, or Azure, including object storage, metastores, and Apache Iceberg.
• Experience operating large-scale streaming and CDC systems using Kafka, Redpanda, and Debezium.
• Strong Python and SQL skills, with experience building reliable data pipelines and platform tooling using orchestration and ingestion frameworks such as Airflow and Airbyte.
• Experience with data governance and access-control frameworks is a plus.

Responsabilités

• Design, develop, and evolve Alpaca’s core data platform, including distributed query engines, orchestration, lakehouse storage, metadata, and cataloging.
• Own our lakehouse infrastructure as code, building reliable and repeatable deployment workflows with Terraform and Ansible on Kubernetes.
• Build and operate scalable, low-latency streaming and CDC pipelines alongside dependable batch ingestion paths into Apache Iceberg.
• Develop and scale our serving and BI infrastructure, giving downstream teams and agents performant, governed, self-service access to lakehouse data.
• Take end-to-end ownership of platform reliability through observability, actionable alerting, on-call practices, incident response, maintenance procedures, runbooks, and service-level objectives.
• Partner with DevOps, Analytics Engineering, and stakeholders across Alpaca to close infrastructure gaps, shape technical requirements, and deliver reusable platform capabilities.

Connaissances

Python

SQL

Airflow

Kafka

Debezium

Kubernetes

Terraform

Ansible

Argo CD

Iceberg

Cloud platforms (GCP/AWS/Azure)

Formation

Bachelor's degree in Computer Science or related field

Outils

Terraform

Helm

Ansible

Argo CD

Description du poste

Who We Are:

Alpaca is a US-headquartered, global leader in agent-first brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24/5 trading, and more. Amongst our subsidiaries, Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs. This includes broker-dealers, investment advisors, wealth managers, hedge funds, and crypto exchanges, totalling over 10 million brokerage accounts.

Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet. We’re deeply committed to open-source contributions and fostering a vibrant community, continuously enhancing our award-winning, developer-friendly API and the robust infrastructure behind it.

Alpaca is proudly backed by $400 million in funding from top-tier global investors including Portage Ventures, Spark Capital, Tribe Capital, Social Leverage, Horizons Ventures, Opera Tech Ventures, SBI Group, Derayah Financial, Unbound, Peak XV, Elefund, and Y Combinator.

Our Team Members:

We’re a dynamic team of 400+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond! We’re searching for passionate individuals eager to contribute to Alpaca’s rapid growth. If you align with our core values—Stay Curious, Have Empathy, and Be Accountable—and are ready to make a significant impact, we encourage you to apply.

About the team & role

The Data Platform team builds and operates the shared infrastructure that powers how data is stored, moved, and consumed across Alpaca. Our platform supports financial transactions, customer data, API and system events, enriched datasets, and third-party sources that power critical decisions and products for internal teams and external stakeholders. We process hundreds of millions of events each day and that scale continues to grow as Alpaca serves more customers and launches new products.

As a Data Platform Engineer, you will build and operate reliable systems across Alpaca’s data platform. You’ll contribute to our distributed query, lakehouse, CDC, and real-time streaming infrastructure while collaborating with experienced engineers and partner teams. You’ll own projects from implementation through production operation and help improve the platform’s scalability, reliability, and developer experience.

Our team is 100% distributed and remote.

Responsibilities:

• Design, develop, and evolve Alpaca’s core data platform, including distributed query engines, orchestration, lakehouse storage, metadata, and cataloging.
• Own our lakehouse infrastructure as code, building reliable and repeatable deployment workflows with Terraform and Ansible on Kubernetes.
• Build and operate scalable, low-latency streaming and CDC pipelines alongside dependable batch ingestion paths into Apache Iceberg.
• Develop and scale our serving and BI infrastructure, giving downstream teams and agents performant, governed, self-service access to lakehouse data.
• Take end-to-end ownership of platform reliability through observability, actionable alerting, on-call practices, incident response, maintenance procedures, runbooks, and service-level objectives.
• Partner with DevOps, Analytics Engineering, and stakeholders across Alpaca to close infrastructure gaps, shape technical requirements, and deliver reusable platform capabilities.

Must-Haves:

• 4+ years of experience in software engineering, data infrastructure, or platform engineering, with demonstrated ownership of complex production systems and technical projects.
• Strong understanding of distributed systems and production experience with query engines such as Trino or Presto.
• Strong experience operating Kubernetes-based data infrastructure using infrastructure-as-code and deployment tools such as Terraform, Helm, Ansible, or Argo CD.
• Experience designing and operating compute platforms across multiple cloud regions, balancing workload locality, peak and bursty demand, resource isolation, workload prioritization, and cost-performance trade-offs.
• Hands-on experience designing and operating cloud lakehouse architectures on GCP, AWS, or Azure, including object storage, metastores, and open table formats, particularly Apache Iceberg.
• Experience operating large-scale streaming and CDC systems using technologies such as Kafka, Redpanda, and Debezium.
• Strong Python and SQL skills, with experience building reliable data pipelines and platform tooling using orchestration and ingestion frameworks such as Airflow and Airbyte.
• Strong operational judgment and the ability to make sound technical decisions, communicate trade-offs, and work effectively through ambiguity.

Nice to Haves:

• Experience with semantic or metrics layers such as Cube, dbt, or Looker.
• Experience deploying and operating infrastructure for AI agents.
• Experience building or integrating context layers that connect structured and unstructured organizational data.
• Experience with data governance and access-control frameworks such as Apache Ranger.

How We Take Care of You:

• Competitive Salary & Stock Options
• Health Benefits
• New Hire Home-Office Setup: One-time USD $500
• Monthly Stipend: USD $150 per month via a Brex Card

Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.

Recruitment Privacy Policy