Senior Data Engineer – Quantitative Data Pipelines

Lumenalta; Ottawa; Remote; CAD 90,000 - 120,000; Part time

Job summary

A leading data solutions company is seeking a Senior Data Engineer to design and maintain efficient data pipelines. You will work closely with data scientists and analysts to ensure high-quality data for quantitative applications. The ideal candidate has over 7 years of experience, strong Python skills, and expertise in AWS and Databricks. This position offers the flexibility of remote work.

Qualifications

• 7+ years of experience as a Data Engineer, with 2 years in Databricks.
• Proficiency in Python and data manipulation.
• Experience in AWS cloud services and data architecture.

Responsibilities

• Design, develop, and maintain ETL/ELT data pipelines.
• Transform data for analysis and machine learning applications.
• Collaborate with data scientists to understand data needs.

Skills

Python

Databricks

AWS

DBT

Apache Airflow

SQL

Data Quality Checks

Collaboration

Tools

ETL/ELT

Pandas

Job description

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta.

2 days ago - Be among the first 25 applicants

Get AI-powered advice on this job and access more exclusive features.

We help global enterprises launch digital products that reach millions of users. Our projects involve massive datasets, complex pipelines, and real-world impact across industries. We're seeking a Data Engineer to join our remote team and help us solve meaningful problems with clean, scalable data solutions.

What You'll Do

• Design, develop, and maintain efficient ETL / ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow
• Transform and prepare data for quantitative analysis and machine learning applications
• Collaborate directly with data scientists and quant analysts to understand their data requirements
• Implement data quality checks and validation processes to ensure accuracy of financial data
• Optimize data models and queries for improved performance
• Document data flows, transformations, and technical specifications
• Support on-the-fly development requests in a fast-paced environment
• Troubleshoot and resolve data pipeline issues independently

What We’re Looking For

• 7+ years of experience as a Data Engineer with at least 2 years focusing on Databricks ecosystem
• Strong proficiency in Python, including data science libraries like Pandas
• Proven experience with AWS cloud services and data architecture
• Experience with DBT for data transformation and documentation
• Familiarity with Apache Airflow for workflow orchestration
• Strong SQL skills for data manipulation and analysis
• Excellent communication skills with ability to collaborate directly with end-users
• Self-starter capable of working independently with minimal supervision
• Ability to work in a fast-paced environment with changing requirements

The job is 100% remote; please ensure you have a comfortable office set at your desired work location.

Seniority level: Mid-Senior level

Employment type: Contract

Job function: Engineering and Information Technology

Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at Lumenalta by 2x.

Get notified about new Data Engineer jobs in Ottawa, Ontario, Canada.

• Python and Kubernetes Software Engineer - Data, AI / ML & Analytics
• Distributed Systems Software Engineer, Python / Go
• Software Engineer I (Consumer Servicing)
• Software Engineer II - Security Engineering
• Senior Software Developer – Lab Integrations
• Python Software Engineer - Ubuntu Hardware Certification Team
• Software Engineer, Ceph & Distributed Storage
• Senior Software Engineer - Infrastructure
• System Software Engineer - Ubuntu Networking
• Senior Software Engineer, Backend (CI / CD)

Senior / Staff Software Engineer, Public Sector

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.

J-18808-Ljbffr