Senior Data Engineer – Quantitative Data Pipelines

Lumenalta; Winnipeg; Remote; CAD 80,000 - 102,000; Full time

Job summary

A leading company in IT consulting is seeking a Senior Data Engineer specialized in developing quantitative data pipelines. This fully remote role involves designing ETL/ELT frameworks, collaborating with analysts, and ensuring data quality for impactful projects. Ideal candidates possess extensive experience in the Databricks ecosystem and strong skills in Python and SQL.

Qualifications

• 7+ years of experience as a Data Engineer with at least 2 years focusing on Databricks.
• Strong proficiency in Python, including data science libraries like Pandas.
• Proven experience with AWS cloud services and data architecture.

Responsibilities

• Design, develop, and maintain efficient ETL/ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow.
• Collaborate with data scientists to understand data requirements.
• Implement data quality checks and validation processes for accuracy.

Skills

Python

SQL

Databricks

AWS

DBT

Apache Airflow

Job description

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta

1 day ago Be among the first 25 applicants

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta

Get AI-powered advice on this job and more exclusive features.

We help global enterprises launch digital products that reach millions of users. Our projects involve massive datasets, complex pipelines, and real-world impact across industries. We're seeking a Data Engineer to join our remote team and help us solve meaningful problems with clean, scalable data solutions.

What You'll Do

• Design, develop, and maintain efficient ETL/ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow
• Transform and prepare data for quantitative analysis and machine learning applications
• Collaborate directly with data scientists and quant analysts to understand their data requirements
• Implement data quality checks and validation processes to ensure accuracy of financial data
• Optimize data models and queries for improved performance
• Document data flows, transformations, and technical specifications
• Support on-the-fly development requests in a fast-paced environment
• Troubleshoot and resolve data pipeline issues independently

What We’re Looking For

• 7+ years of experience as a Data Engineer with at least 2 years focusing on Databricks ecosystem
• Strong proficiency in Python, including data science libraries like Pandas
• Proven experience with AWS cloud services and data architecture
• Experience with DBT for data transformation and documentation
• Familiarity with Apache Airflow for workflow orchestration
• Strong SQL skills for data manipulation and analysis
• Excellent communication skills with ability to collaborate directly with end-users
• Self-starter capable of working independently with minimal supervision
• Ability to work in a fast-paced environment with changing requirements

The job is 100% Remote; please ensure you have a comfortable office set at your desired work location.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lumenalta by 2x

Sign in to set job alerts for “Data Engineer” roles.

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Software Engineer (Python/Linux/Packaging)

Graduate Software Engineer, Open Source and Linux, Canonical Ubuntu

Winnipeg, Manitoba, Canada CA$80,000.00-CA$102,000.00 1 week ago

Distributed Systems Software Engineer, Python / Go

Software Engineer I (Consumer Servicing)

Software Engineer I (Merchant Data Platform)

Software Engineer - Solutions Engineering

Python Software Engineer - Ubuntu Hardware Certification Team

System Software Engineer - Ubuntu Networking

Software Engineer, Ceph & Distributed Storage

System Software Engineer - GCC/LLVM compiler, tooling, and ecosystem

Greater Winnipeg Metropolitan Area 22 hours ago

Software Engineer II, Backend (Consumer Authentication)

Software Engineer - packaging - optimize Ubuntu Server for public clouds

Software Engineer II (Capacity Engineering)

Golang System Software Engineer - Containers / Virtualisation

Senior Software Engineer - Digital Workplace

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.