Sr Data Engineer (Azure Databricks)

Altis

Toronto

Hybrid

CAD 110,000 - 140,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Altis is seeking a Senior Data Engineer in Toronto for a 6‑month contract to support a major Eagle platform upgrade. You will build automated reconciliation and regression tests to ensure data accuracy throughout the transition.

You will collaborate with Core Data, Performance, IT teams and partners, applying Azure data engineering practices to validate data across positions, transactions, holdings, valuations, cash, and reference data, while enabling smooth cutover.

Qualifications

  • 7+ years hands-on data engineering or data warehousing experience.
  • Production‑level Azure Databricks and Python/PySpark experience.
  • Advanced Oracle SQL/PLSQL skills for large datasets.
  • Experience building automated reconciliation/validation or regression testing.
  • Experience with investment management or capital-markets data preferred.

Responsibilities

  • Build reusable reconciliation and regression‑testing solutions using Azure Databricks, Python/PySpark, Spark SQL, and Oracle SQL/PLSQL.
  • Compare current and upgraded Eagle environments, investigating variances and root causes.
  • Automate validation across positions, transactions, holdings, reference data, valuations, cash, and performance outputs.
  • Develop configurable comparison logic, tolerance thresholds, exception reporting, logging, and pass/fail results.
  • Support test cycles, defect remediation, retesting, and obtain business sign‑off with traceable evidence.
  • Apply source control and CI/CD practices, preferably with Azure DevOps, for repeatable execution.

Skills

7+ years data engineering
Azure Databricks
Python/PySpark
Oracle SQL/PLSQL
data reconciliation & testing
stakeholder communication

Job description

Location: Toronto, Hybrid (2-3 days per week, near Union Station)

Language: English, strong written and spoken communication required

Duration: 6-month contract, January 4, 2027 to June 30, 2027

About the Opportunity

Join a leading institutional investment organization as a Senior Data Engineer supporting a major Eagle platform upgrade. You’ll play a key role in building automated reconciliation and regression-testing solutions that help ensure critical investment data remains accurate, complete, and reliable throughout the transition.

Working closely with Core Data, Performance, IT teams, and technology partners, you’ll bring strong data engineering expertise to a high-impact transformation. Your work will span positions, transactions, holdings, valuations, cash, reference data, and performance outputs, helping teams confidently validate the upgraded environment and prepare for cutover.

What’s In It for You
  • Work on a high-profile data transformation within a sophisticated investment environment
  • Gain exposure to complex investment data, enterprise platforms, and upgrade initiatives
  • Collaborate with experienced technical and business teams across the organization
  • Apply modern Azure data engineering practices while solving meaningful data-quality challenges
Your Responsibilities
  • You’ll build reusable reconciliation and regression-testing solutions using Azure Databricks, Python/PySpark, Spark SQL, and Oracle SQL/PLSQL.
  • You’ll compare current and upgraded Eagle environments and downstream platforms, investigating variances and root causes.
  • You’ll automate validation across positions, transactions, holdings, reference data, valuations, cash, and performance-related outputs.
  • You’ll develop configurable comparison logic, tolerance thresholds, exception reporting, logging, monitoring, and clear pass/fail results.
  • You’ll support test cycles, defect remediation, retesting, business sign-off, and produce traceable technical evidence and documentation.
  • You’ll apply source control and CI/CD practices, preferably using Azure DevOps, while developing repeatable execution processes.
Skills and Qualifications
  • 7+ years of hands‑on data engineering, data warehousing, data integration, or data-quality engineering experience
  • Strong production‑level Azure Databricks and Python/PySpark experience, including automated data comparison and testing
  • Advanced Oracle SQL/PLSQL skills, including complex queries, performance tuning, and troubleshooting large datasets
  • Proven experience developing automated data reconciliation, validation, or regression-testing solutions
  • Experience with investment management, asset management, banking, or capital-markets data and business processes
  • Strong analytical, problem‑solving, documentation, and stakeholder communication skills
  • Nice to have: Experience with Eagle PACE, Eagle Data Management, Eagle Accounting, pytest, Azure Data Factory, Airflow, Snowflake, Power BI, or broader Azure data services is an asset

We appreciate the time and effort all applicants invest in their submissions. Please note that only candidates shortlisted for this role will be contacted directly. However, your profile will remain under consideration for future opportunities that align with your experience and career goals. All qualified applicants will receive fair consideration for employment. We welcome individuals of all backgrounds, experiences, and identities including those who identify as women, members of racialized groups, Indigenous Peoples, persons with disabilities, and 2SLGBTQIA+ communities. If you require an accommodation, please review accessibility policy and reach out to our accessibility officer with any questions. Our human recruiters review all applications and always make the final hiring decision. On occasion, we also use AI‑assisted tools to help review applications.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Data Engineer
Sr. Data Engineer

Recruiting in Motion • Toronto

Hybrid
CAD 120,000 - 140,000
Senior Data Architect / Data Modeller, AI/ML & Cloud
Senior Data Architect / Data Modeller, AI/ML & Cloud

Altis • Toronto

Hybrid
CAD 90,000 - 165,000
IT - Site Reliability Engineer IV - Toronto
IT - Site Reliability Engineer IV - Toronto

Randstad • Toronto

Hybrid
CAD 120,000 - 180,000
Greenfield project ownership
Contract with conversion potential
Modern cloud & big data stack
+1
Software Developer - ETL
Software Developer - ETL

Altis • Toronto

Hybrid
CAD 96,000 - 152,000
Senior Data Engineer
Senior Data Engineer

Cpus Engineering Staffing Solutions Inc. • Pickering

Hybrid
CAD 90,000 - 120,000
Site Reliability Engineer
Site Reliability Engineer

Us Tech Solutions • Toronto

Hybrid
CAD 140,000 - 190,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Raise - find a more meaningful working experience • Toronto

Hybrid
CAD 100,000 - 167,000
Data Engineer (Databricks)
Data Engineer (Databricks)

Cpus Engineering Staffing Solutions Inc. • Oshawa

Hybrid
CAD 124,000 - 131,000
Senior Databricks Developer
Senior Databricks Developer

Global Technical Talent • Toronto

Hybrid
CAD 103,000 - 131,000
Hybrid work arrangement
Azure Data Migration Engineer Contract (1775)
Azure Data Migration Engineer Contract (1775)

Direct IT Recruiting Inc. • Toronto

Hybrid
CAD 80,000 - 100,000