Data Engineer

Epsilon Solutions Ltd.; Canada; On-site; CAD 80,000 - 100,000; Full time

Job summary

A technology solutions company located in Canada is seeking a candidate with expertise in data engineering. Applicants should have proven experience converting SAS EG code to technologies like PySpark and SQL, as well as familiarity with DB2 and mainframe systems. Responsibilities include optimizing data conversion and documentation. This role offers an exciting opportunity to work with a variety of tools and technologies, ensuring data governance compliance and project delivery excellence.

Qualifications

• Proven experience converting SAS EG code to PySpark, SQL, and/or R.
• Familiarity with SAS macros, data steps, and PROC SQL.
• Experience accessing DB2 data via ODBC/JDBC or ETL tools.

Responsibilities

• Optimize PySpark code for performance and scalability.
• Experience successfully onboarding with client systems.
• Document conversion logic and testing results.

Skills

SAS EG to PySpark conversion

SQL

R

Databricks notebooks

Delta Lake

Spark SQL

DB2 data access

Mainframe systems

Automation frameworks

Version control (Git)

CI/CD integration

Tools

SAS2PY

SPROCKET

Scintilla

AI tools

Azure DevOps

Job description

b) Technical Expertise

• Proven experience converting SAS EG code to PySpark, SQL, and/or R
• Familiarity with SAS macros, data steps, and PROC SQL
• Experience with Databricks notebooks, Delta Lake, and Spark SQL
• Ability to optimize PySpark code for performance and scalability

c) Mainframe & DB2 Integration

• Experience accessing DB2 data via ODBC/JDBC or ETL tools
• Familiarity with mainframe systems (JCL, COBOL, IMS)
• Ability to replicate or migrate data from DB2 to cloud data lake

d) Tooling & Automation

• Use of SAS-to-PySpark conversion tools (e.g., SAS2PY, SPROCKET, Scintilla, AI tools)
• Automated testing and validation frameworks for data parity
• Schema mapping and lineage tracking capabilities

e) Project Delivery & Governance

• Experience successfully onboarding with client systems.
• Clear documentation of conversion logic and testing results
• Version control and CI/CD integration (e.g., Git, Azure DevOps)
• Compliance with internal data governance and security policies

Databricks Platform

• Databricks Certified Data Engineer Associate or Professional
• Databricks Certified Machine Learning Associate or Professional