Database Engineer

Liquid Analytics

Collingwood

On-site

CAD 110,000 - 150,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Liquid Analytics in Collingwood, Ontario, is hiring a Senior Database Engineer to design, optimize, and scale complex data workflows using DuckDB, PostgreSQL, and Python. The role focuses on data modeling, performance tuning, and integrating ML methods into data pipelines.

The position requires 6+ years of experience, strong communication skills, and collaboration with product managers and software architects. Office presence is expected twice weekly at our Collingwood office.

Qualifications

  • 6+ years of relevant work experience.
  • Expertise in Database Design, Query Engine Design, and storage engines.
  • Excellent written and spoken communication skills.
  • Experience with DuckDB and PostgreSQL.
  • Experience with data pipelines and ML/EDA concepts.

Responsibilities

  • Design, develop, and optimize SQL queries and Python macros for data transformations in DuckDB.
  • Implement data normalization/denormalization to ensure data integrity and performance.
  • Transform data pipelines and integrate statistical and ML methods into SQL and Python workflows.
  • Collaborate with cross-functional teams to define data architecture and enhance the lb_duckdb_manager functionality.
  • Ensure high performance and scalability of database operations through performance tuning and indexing strategies.
  • Manage changes that ripple across tables with efficient update processes and monitoring.
  • Write platform-grade Python code following best practices and coding standards.
  • Mentor junior developers in database design and SQL transformations.
  • Work with GenAI tools in IDE environments (Visual Studio Code, Jupyter Notebook).

Skills

SQL optimization
Python development
Data modeling
Communication
Mentoring

Tools

DuckDB
PostgreSQL
Spark
DBT
Kafka
Dagster
Flink
Git
CI/CD

Job description

Design and build scalable, high-performance systems that enhance our decision-making platform's efficiency and reliability.

About the job

We are seeking a Senior Database Engineer with 6+ years of experience to join our Data Platform team. You will design, prototype, and optimize complex data workflows and architectures, focusing on SQL optimization, Python development, and data-driven analysis. This role requires advanced technical expertise and the ability to work collaboratively with the product manager and software architect.

Key Responsibilities

Design, develop, and optimize complex SQL queries and Python macros for data transformations within the DuckDB framework.

Implement advanced data normalization and denormalization strategies to ensure data integrity and performance.

Perform data pipeline transformations and integrate statistical and ML methods into SQL and Python workflows.

Collaborate with cross-functional teams to define data architecture and enhance the lb_duckdb_manager's functionality.

Ensure high performance and scalability of database operations through performance tuning and effective indexing strategies.

Manage changes that need to ripple across tables in the dataset, leveraging efficient update processes and monitoring tools.

Write platform-grade Python code while adhering to best practices and coding standards.

Mentor junior developers, sharing expertise in database design and SQL transformations.

Job Requirements

6+ years of relevant work experience

Expertise in Database Design, Query Engine Design, Database storage engines

Excellent ability to map business domains to data models

Excellent written and spoken communication skills

Advanced SQL Development: Optimize complex queries (CTEs, window functions, pivots, grouping sets) in DuckDB and PostgreSQL.

Data Pipeline Design: Build and optimize data workflows using Python and modern tools like Spark, DBT, Kafka, Dagster, and Flink.

Exploratory Data Analysis (EDA): Apply statistical methods and machine learning principles to derive insights and drive decision-making.

Integration of GenAI Tools: Work seamlessly with tools in IDE environments (Visual Studio Code, Jupyter Notebook).

DataOps and DevOps: Design and optimize pipelines, manage Git-based version control, and implement CI/CD workflows.

Collaboration: Document requirements and analysis, communicate effectively with clients, and contribute to a user-centric development process.

Our office is located in Collingwood, Ontario. You must be willing to come to the office twice a week.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Aarorn Technologies Inc • Markham

On-site
CAD 68,880 - 89,544
Senior Data Engineer
Senior Data Engineer

Bridgenext • Toronto

Hybrid
CAD 120,000 - 180,000
Database Platform Engineer
Database Platform Engineer

Humankind Global Recruitment • Halifax

On-site
CAD 120,000 - 180,000
Medical & health benefits
RRSP matching
Data Engineer
Data Engineer

Jliconsulting • Vaughan

On-site
CAD 80,000 - 100,000
Data Platform Engineer
Data Platform Engineer

Evolutionary Recruiting • Edmonton

Hybrid
CAD 90,000 - 130,000
Data & Analytics lead
Data & Analytics lead

Altis • Markham

Hybrid
CAD 100,000 - 125,000
Database Administrator
Database Administrator

Eizie • Kitamaat

On-site
CAD 90,000 - 120,000
Competitive salary
Health benefits
Professional development
+5
Software Developer - Data Services
Software Developer - Data Services

GuruLink • Montreal

On-site
CAD 80,000 - 100,000
Senior Data Engineer
Senior Data Engineer

Exchange Solutions • Toronto

On-site
CAD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

UNAVAILABLE • Toronto

Hybrid
CAD 110,000 - 160,000
Hybrid schedule
Office options in Toronto/Vancouver/Co
Contract role