Senior Data Engineer - Remote Canada (Databricks)

coconutsoftware; United States; Remote; USD 63,000 - 91,000; Full time

Benefits offered by this job

Health and dental coverage

Virtual care

Disability coverage

Mental health support

Retirement savings matching

Annual wellness allowance

Internet subsidy

Incentive programs

Job summary

coconutsoftware engineers a modern analytics platform by owning data pipelines for workforce forecasting and staffing products. This 12-month contract role operates remotely from Canada, with responsibilities spanning ingestion, transformation, migration, reliability, and comprehensive documentation.

You will collaborate with analytics engineers and product teams, lead migrations from Redshift to Databricks, manage data replication, and ensure data contracts protect schema evolution while

Qualifications

• Five or more years in data engineering, including production Databricks with Delta, Jobs, DLT or Lakeflow, and Unity Catalog.

Responsibilities

• Build and operate production pipelines in Databricks, from customer file ingestion through curated tables for models and reporting, using tools such as Lakeflow, Jobs, and dbt.
• Lead further migration from Redshift to Databricks, including source table landing, product analytics migration, and retirement of legacy warehouse components.
• Manage replication and ingestion from production databases and files across environments, accounting for data residency and personally identifiable information.
• Agree on data contracts with internal teams and external machine learning partners to manage schema changes safely.
• Monitor pipeline health, data quality, and platform costs; support the team’s on-call rotation.
• Estimate effort, explain trade-offs, document designs and runbooks, and help improve engineering practices, including thoughtful use of AI tools.

Skills

Python

SQL

dbt

Databricks

Delta Lake

Unity Catalog

AWS data services

Change data capture

Tools

Lakeflow

Jobs

dbt

Databricks

Delta

Unity Catalog

Terraform

Databricks Asset Bundles

LookML

Looker

AI coding agents

Job description

coconutsoftware engineers a modern analytics platform by owning data pipelines for workforce forecasting and staffing products. This 12-month contract role operates remotely from Canada, with responsibilities spanning ingestion, transformation, migration, reliability, and comprehensive documentation.

You will collaborate with analytics engineers and product teams, lead migrations from Redshift to Databricks, manage data replication, and ensure data contracts protect schema evolution while