Data Engineer: SAS-to-PySpark & Databricks Expert

Epsilon Solutions Ltd.; Canada; On-site; CAD 80,000 - 100,000; Full time

Job summary

A technology solutions company located in Canada is seeking a candidate with expertise in data engineering. Applicants should have proven experience converting SAS EG code to technologies like PySpark and SQL, as well as familiarity with DB2 and mainframe systems. Responsibilities include optimizing data conversion and documentation. This role offers an exciting opportunity to work with a variety of tools and technologies, ensuring data governance compliance and project delivery excellence.

Qualifications

• Proven experience converting SAS EG code to PySpark, SQL, and/or R.
• Familiarity with SAS macros, data steps, and PROC SQL.
• Experience accessing DB2 data via ODBC/JDBC or ETL tools.

Responsibilities

• Optimize PySpark code for performance and scalability.
• Experience successfully onboarding with client systems.
• Document conversion logic and testing results.

Skills

SAS EG to PySpark conversion

SQL

R

Databricks notebooks

Delta Lake

Spark SQL

DB2 data access

Mainframe systems

Automation frameworks

Version control (Git)

CI/CD integration

Tools

SAS2PY

SPROCKET

Scintilla

AI tools

Azure DevOps

Job description

A technology solutions company located in Canada is seeking a candidate with expertise in data engineering. Applicants should have proven experience converting SAS EG code to technologies like PySpark and SQL, as well as familiarity with DB2 and mainframe systems. Responsibilities include optimizing data conversion and documentation. This role offers an exciting opportunity to work with a variety of tools and technologies, ensuring data governance compliance and project delivery excellence.