Senior Data Engineer – Quantitative Data Pipelines

Lumenalta; Canada; Remote; CAD 90,000 - 130,000; Full time

Job summary

A leading company is seeking a Senior Data Engineer to join their remote team. The role involves designing efficient data pipelines using Databricks and AWS, transforming data for analysis, and ensuring data quality. Ideal candidates will have extensive experience in data engineering and be proficient in Python. Join to explore meaningful problem-solving opportunities with large datasets.

Qualifications

• 7+ years of experience as a Data Engineer, focused on Databricks ecosystem for 2 years.
• Proficient in Python with data science libraries like Pandas.
• Strong SQL skills for data manipulation and analysis.

Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines using Databricks and AWS.
• Implement data quality checks and documentation of data flows.
• Optimize data models for performance improvements.

Skills

Python

Data Engineering

AWS

SQL

Apache Airflow

DBT

Data Quality Checks

Job description

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta

4 days ago Be among the first 25 applicants

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta

We help global enterprises launch digital products that reach millions of users. Our projects involve massive datasets, complex pipelines, and real-world impact across industries. We're seeking a Data Engineer to join our remote team and help us solve meaningful problems with clean, scalable data solutions.

What You'll Do

• Design, develop, and maintain efficient ETL/ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow
• Transform and prepare data for quantitative analysis and machine learning applications
• Collaborate directly with data scientists and quant analysts to understand their data requirements
• Implement data quality checks and validation processes to ensure accuracy of financial data
• Optimize data models and queries for improved performance
• Document data flows, transformations, and technical specifications
• Support on-the-fly development requests in a fast-paced environment
• Troubleshoot and resolve data pipeline issues independently

What We’re Looking For

• 7+ years of experience as a Data Engineer with at least 2 years focusing on Databricks ecosystem
• Strong proficiency in Python, including data science libraries like Pandas
• Proven experience with AWS cloud services and data architecture
• Experience with DBT for data transformation and documentation
• Familiarity with Apache Airflow for workflow orchestration
• Strong SQL skills for data manipulation and analysis
• Excellent communication skills with ability to collaborate directly with end-users
• Self-starter capable of working independently with minimal supervision
• Ability to work in a fast-paced environment with changing requirements

The job is 100% Remote; please ensure you have a comfortable office set at your desired work location.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lumenalta by 2x

Get notified about new Data Engineer jobs in Canada.

Dartmouth, Nova Scotia, Canada 6 days ago

Senior Software Engineer - Data Platform

Mississauga, Ontario, Canada CA$99,600.00-CA$107,100.00 5 hours ago

Full-Stack Software Engineer (New graduates: Canada)

Canada CA$80,000.00-CA$120,000.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.