Senior Data Engineer — Data Platform Lead (Hybrid)

Swoop; Toronto; Hybrid; CAD 195,000 - 228,000; Full time

Job summary

Swoop is seeking a Senior Data Engineer to own NimbleRx’s data platform, enabling teams to understand the business and ship features while meeting compliance obligations. You’ll scale data pipelines and partner with product, analytics, and operations to deliver reliable data services.

You will work at the intersection of production and data engineering, driving security, performance, and AI-enabled tooling across a growing organization with a patient-first focus.

Qualifications

• 5+ years building production data pipelines and platforms.
• Deep Python (PySpark) and SQL fluency.
• The skills and willingness to work on the services around the data layer (Java, Spring Boot).
• Hands-on experience with distributed compute (Spark/EMR), streaming (Kinesis), and object storage (S3).
• Solid Postgres fundamentals — query optimization, indexing, replication, replica routing, bottlenecks.
• Experience with Iceberg and Trino, or similar.
• Comfort with CI/CD and Terraform.
• Already building with AI — frontier models, agentic coding tools, or something you hacked together last weekend.
• Track record of working across teams that don't speak your language (product, ops, etc.)

Responsibilities

• Own the data platform end-to-end — ingestion, transformation, storage, query, and access.
• Build and evolve batch and streaming pipelines on PySpark/EMR, Kinesis, Lambda, and Step Functions.
• Model the warehouse: design SCD tables and event tables.
• Collaborate with product, engineering, analytics, and operations to turn data requests into pipelines.
• Own the security and compliance backbone of our data systems.
• Optimize backend query performance where the data layer meets product code.
• Lead investigation and remediation when data infrastructure misbehaves and make fixes durable.
• Use AI to accelerate pipeline scaffolding and tooling; ship internal AI tooling.
• Mentor engineers and analysts on using the data platform.

Skills

Python/PySpark

SQL

Java/Spring Boot

Data pipelines

Security & governance

AI tooling

Cross-team collaboration

Ownership

Performance tuning

Tools

Iceberg

Trino

Kinesis

EMR

Spark

Postgres

S3

Terraform

Job description

Swoop is seeking a Senior Data Engineer to own NimbleRx’s data platform, enabling teams to understand the business and ship features while meeting compliance obligations. You’ll scale data pipelines and partner with product, analytics, and operations to deliver reliable data services.

You will work at the intersection of production and data engineering, driving security, performance, and AI-enabled tooling across a growing organization with a patient-first focus.