Senior Data Platform Engineer — Scale, Security & AI

Swoop Airlines and Aviation; Toronto; On-site; CAD 120,000 - 150,000; Full time

Job summary

NimbleRx is seeking a Senior Data Engineer to own our data platform end-to-end, enabling analytics, product, and compliance as the business scales. You will work at the intersection of production engineering and data engineering to build robust pipelines and mentor teams.

The role emphasizes security, reliability, and scalable data solutions that empower multiple teams across the organization. You’ll lead initiatives with AI tooling and ensure governance and performance at scale.

Qualifications

• 5+ years building production data pipelines and platforms.
• Proficient in Python (PySpark) and SQL with Spark tuning.
• Experience with Java and Spring Boot in data services.
• Hands-on with distributed compute (Spark/EMR), Kinesis, and S3.
• Strong Postgres fundamentals: indexing, replication, optimization.
• Experience with Iceberg and Trino or similar.
• Familiar with CI/CD and Terraform.
• Experience building AI-powered tooling and experiments.
• Track record working across cross-functional teams.

Responsibilities

• Own the data platform end-to-end and drive its roadmap.
• Build and evolve batch/streaming pipelines (PySpark/EMR, Kinesis, Lambda, Step Functions) to Iceberg lake.
• Model the warehouse with SCD and event tables.
• Collaborate with product, eng, analytics, and ops to turn data requests into reliable pipelines and self-serve tooling.
• Own security and compliance: audit logs, access control, temporary-access workflows.
• Optimize query performance: read-replica routing, indexing, caching, IO instrumentation in Java/Spring.
• Lead remediation of data infra issues: outages, schema drift, late data.
• Use AI to accelerate pipelines and create internal AI tooling for others.
• Mentor engineers and analysts on using the data platform.

Skills

Data pipelines

Python PySpark

SQL

Java Spring Boot

Distributed compute stack

Postgres fundamentals

Iceberg/Trino

CI/CD

AI tooling

Cross-team collaboration

Job description

NimbleRx is seeking a Senior Data Engineer to own our data platform end-to-end, enabling analytics, product, and compliance as the business scales. You will work at the intersection of production engineering and data engineering to build robust pipelines and mentor teams.

The role emphasizes security, reliability, and scalable data solutions that empower multiple teams across the organization. You’ll lead initiatives with AI tooling and ensure governance and performance at scale.