Remote Data Engineer: Build Scalable Databricks Pipelines

Irth Solutions, L.L.C.; Quebec; Hybrid; CAD 64,000 - 86,000; Full time

Benefits offered by this job

Competitive Salary

Medical, Dental, and Vision Insurance

401(k) Plan with Company Match

Generous PTO

Company-Paid Holidays

Flexible Work Options

On-Call Compensation

Job summary

Irth Solutions is seeking a Mid-level Data Engineer to design, build, and maintain high-volume data pipelines in Databricks, transforming external data into clean, analysis-ready inputs for downstream intelligence. You will work closely with data scientists and application teams to support Stakeholder Engagement platforms.

The role emphasizes Spark/PySpark, SQL, and Delta Lake, with a focus on scalability, data quality, and reliable operations.

Qualifications

• 3 to 5 years of experience in data engineering, building and operating production data pipelines.
• Familiarity with data modeling, data quality, and schema evolution.
• Strong reliability practices: monitoring, alerting, and graceful failure handling.

Responsibilities

• Design, build, and maintain ingestion pipelines from external APIs at scale.
• Implement Delta Lake storage and medallion architectures for clean data layers.
• Ensure pipeline reliability with error handling, retries, monitoring, and alerts.
• Collaborate with Data Scientists and application teams to expose structured data for NLP/LLM pipelines.
• Document pipelines, data dictionaries, schedules, and transformation logic.

Skills

Databricks

Python

SQL

Data pipelines

APIs

Cloud platforms

Tools

Databricks

Git

CI/CD

Job description

Irth Solutions is seeking a Mid-level Data Engineer to design, build, and maintain high-volume data pipelines in Databricks, transforming external data into clean, analysis-ready inputs for downstream intelligence. You will work closely with data scientists and application teams to support Stakeholder Engagement platforms.

The role emphasizes Spark/PySpark, SQL, and Delta Lake, with a focus on scalability, data quality, and reliable operations.