PySpark Migration Engineer – SAS to Spark on Cloud

JIT Global Freight Solution P Ltd

Ontario (CA)

On-site

USD 90,000 - 130,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

JIT Global Freight Solution P Ltd is seeking a skilled PySpark Developer to lead the migration of legacy SAS workflows to scalable PySpark solutions. The role focuses on modernizing data infrastructure and enabling advanced analytics across cloud platforms.

Responsibilities include reverse engineering SAS programs, building PySpark modules, and developing ETL pipelines with AWS and Snowflake. Collaboration with data scientists, analysts, and cloud engineers is essential for success.

Qualifications

Bachelor's degree in Computer Science, Engineering, or related field.
3+ years of experience in SAS programming and data engineering.
2+ years of hands-on experience with PySpark and big data technologies.
Strong understanding of data structures, algorithms, and performance tuning.
Experience with cloud platforms (AWS, Azure, Snowflake) and distributed computing.

Responsibilities

Analyze and reverse engineer existing SAS programs, macros, and data flows.
Design and implement equivalent PySpark modules optimized for performance and scalability.
Develop and maintain ETL pipelines using PySpark integrated with AWS, Snowflake/DataBricks.
Validate migrated outputs against SAS baselines to ensure accuracy and consistency.
Collaborate with cross-functional teams including data scientists, business analysts, and cloud engineers.
Document technical specifications, migration strategies, and validation protocols.
Participate in sprint planning, estimation, and delivery of migration milestones.