Data Test Engineer - Databricks & Lakehouse

Citco; Toronto; On-site; CAD 105,000 - 135,000; Full time

Benefits offered by this job

Benefits package

Flexible working arrangements

Job summary

Citco is seeking a Test Engineer - Data to design and implement automated testing for Databricks-based data pipelines and Lakehouse architectures. You will collaborate with data engineers to ensure data accuracy, reliability, and governance across ETL/ELT processes and Delta Live Tables.

The role requires 2+ years in Databricks/Spark, Python (PySpark), SQL, and data testing tools, with knowledge of AWS services and data governance. A modern, agile environment with growth opportunities awaits.

Qualifications

• Bachelor's degree in Computer Science, Data Science, or related field.
• Databricks certification or data testing credentials are a plus.
• 2+ years hands-on Databricks (Spark) experience.
• Strong Python (PySpark) and SQL programming skills.

Responsibilities

• Automate testing for ETL/ELT processes in Databricks and Spark jobs.
• Develop automated testing frameworks for Databricks notebooks and Delta Lake tables.
• Create test cases for data ingestion, transformations, and quality checks.
• Design monitoring test frameworks and automated dashboards for QA metrics.

Skills

Python (PySpark)

SQL

Problem-solving

Analytical thinking

Agile methodologies

Education

Bachelor's degree in Computer Science or related

Databricks certification (plus)

Tools

Databricks

Git

Delta Lake

Delta Live Tables

Unity Catalog

Job description

Citco is seeking a Test Engineer - Data to design and implement automated testing for Databricks-based data pipelines and Lakehouse architectures. You will collaborate with data engineers to ensure data accuracy, reliability, and governance across ETL/ELT processes and Delta Live Tables.

The role requires 2+ years in Databricks/Spark, Python (PySpark), SQL, and data testing tools, with knowledge of AWS services and data governance. A modern, agile environment with growth opportunities awaits.