Senior Data Platform Engineer

Alpaca; Southwestern Ontario; Remote; CAD 80,000 - 100,000; Full time

Job summary

A leading brokerage firm is seeking a Senior Data Engineer to design and develop data management solutions. This 100% remote role requires 7+ years of engineering experience, proficiency in Python and SQL, and knowledge of cloud-native technologies. You'll be responsible for overseeing ETL processes and collaborating with various teams to enhance data flow. The firm offers a competitive salary, stock options, and health benefits.

Benefits

Competitive Salary & Stock Options

Health Benefits

New Hire Home-Office Setup: One-time USD $500

Monthly Stipend: USD $150 per month

Qualifications

• 7+ years of experience in data engineering.
• 2+ years of building scalable, low-latency data platforms.
• Experience with production streaming systems like Kafka.

Responsibilities

• Design and oversee ETL patterns for data delivery.
• Develop scalable patterns in the transformation layer.
• Collaborate with teams to address data flow needs.

Skills

Data engineering

Python

SQL

ETL technologies (Airflow, Airbyte)

Distributed systems

Tools

Docker

Kubernetes

Helm

Job description

Who We Are

Alpaca is a US-headquartered self-clearing broker-dealer and brokerage infrastructure for stocks, ETFs, options, crypto, fixed income, 24 / 5 trading, and more.

Alpaca is a licensed financial services company, serving hundreds of financial institutions across 40 countries with our institutional-grade APIs.

Our global team is a diverse group of experienced engineers, traders, and brokerage professionals who are working to achieve our mission of opening financial services to everyone on the planet.

Our Team Members

We're a dynamic team of 230+ globally distributed members who thrive working from our favorite places around the world, with teammates spanning the USA, Canada, Japan, Hungary, Nigeria, Brazil, the UK, and beyond.

Your Role

We are seeking a Senior Data Engineer to design and develop the data management layer for our platform to ensure its scalability as we expand to larger customers and new jurisdictions.

We prioritize open-source solutions in our data management approach, leveraging a Google Cloud Platform (GCP) foundation for our data infrastructure.

Our team is 100% distributed and remote.

Things You Get To Do

• Design and oversee key forward and reverse ETL patterns to deliver data to relevant stakeholders.
• Develop scalable patterns in the transformation layer to ensure repeatable integrations with BI tools across various business verticals.
• Expand and maintain the constantly evolving elements of the Alpaca Data Lakehouse architecture.
• Collaborate closely with sales, marketing, product, and operations teams to address key data flow needs.
• Operate the system and manage production issues in a timely manner.

Who You Are (Must-Haves)

• 7+ years of experience in data engineering, including 2+ years of building scalable, low-latency data platforms capable of handling 100M events / day.
• Proficiency in at least one programming language, with strong working knowledge of Python and SQL.
• Experience with cloud-native technologies like Docker, Kubernetes, and Helm.
• Strong hands-on experience with relational database systems.
• Experience in building scalable transformation layers, preferably through formalized SQL models (e.g., dbt).
• Ability to work in a fast-paced environment and adapt solutions to changing business needs.
• Experience with ETL technologies like Airflow and Airbyte.
• Production experience with streaming systems like Kafka.
• Exposure to infrastructure, DevOps, and Infrastructure as Code (IaaC).
• Deep knowledge of distributed systems, storage, transactions, and query processing.

How We Take Care of You

• Competitive Salary & Stock Options
• Health Benefits
• New Hire Home-Office Setup: One-time USD $500
• Monthly Stipend: USD $150 per month via a Brex Card

Alpaca is proud to be an equal opportunity workplace dedicated to pursuing and hiring a diverse workforce.