Senior Data Engineer – Quantitative Data Pipelines

Lumenalta; Ottawa; Remote; CAD 100,000 - 130,000; Full time

Job summary

A leading company in IT Services and Consulting is seeking a Senior Data Engineer who will work remotely to develop and maintain data pipelines. The ideal candidate should have extensive experience in Databricks, AWS, and Python, and will help create scalable data solutions for meaningful projects in various industries. This role requires a self-starter who can work independently in a dynamic environment.

Qualifications

• 7+ years of experience as a Data Engineer, with 2+ years on Databricks.
• Strong proficiency in Python, especially data science libraries.
• Experience with AWS and data architecture is essential.

Responsibilities

• Design and maintain ETL/ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow.
• Ensure data quality checks and validations.
• Collaborate with data scientists to meet data requirements.

Skills

Python

AWS

SQL

Databricks

DBT

Apache Airflow

Job description

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta

1 day ago Be among the first 25 applicants

Join to apply for the Senior Data Engineer – Quantitative Data Pipelines role at Lumenalta

We help global enterprises launch digital products that reach millions of users. Our projects involve massive datasets, complex pipelines, and real-world impact across industries. We're seeking a Data Engineer to join our remote team and help us solve meaningful problems with clean, scalable data solutions.

What You'll Do

• Design, develop, and maintain efficient ETL/ELT data pipelines using Databricks, AWS, DBT, and Apache Airflow
• Transform and prepare data for quantitative analysis and machine learning applications
• Collaborate directly with data scientists and quant analysts to understand their data requirements
• Implement data quality checks and validation processes to ensure accuracy of financial data
• Optimize data models and queries for improved performance
• Document data flows, transformations, and technical specifications
• Support on-the-fly development requests in a fast-paced environment
• Troubleshoot and resolve data pipeline issues independently

What We’re Looking For

• 7+ years of experience as a Data Engineer with at least 2 years focusing on Databricks ecosystem
• Strong proficiency in Python, including data science libraries like Pandas
• Proven experience with AWS cloud services and data architecture
• Experience with DBT for data transformation and documentation
• Familiarity with Apache Airflow for workflow orchestration
• Strong SQL skills for data manipulation and analysis
• Excellent communication skills with ability to collaborate directly with end-users
• Self-starter capable of working independently with minimal supervision
• Ability to work in a fast-paced environment with changing requirements

The job is 100% Remote; please ensure you have a comfortable office set at your desired work location.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Lumenalta by 2x

Get notified about new Data Engineer jobs in Ottawa, Ontario, Canada.

Freelance GenAI Developer - Prompt Engineering & Data Workflows

Intermediate Full Stack Developer (Data)

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Freelance Data Analyst (Python) - AI Trainer

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Software Engineer (Python/Linux/Packaging)

Distributed Systems Software Engineer, Python / Go

Software Engineer I (Consumer Servicing)

Software Engineer I (Merchant Data Platform)

Graduate Software Engineer, Open Source and Linux, Canonical Ubuntu

Software Engineer - Solutions Engineering

Senior Software Engineer (SEO Team, Full Stack)

Python Software Engineer - Ubuntu Hardware Certification Team

System Software Engineer - GCC/LLVM compiler, tooling, and ecosystem

Software Engineer, Ceph & Distributed Storage

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.