PySpark Developer at Cloudious LLC Ontario, CA

JIT Global Freight Solution P Ltd; Ontario (CA); On-site; USD 90,000 - 130,000; Full time

Job summary

JIT Global Freight Solution P Ltd is seeking a skilled PySpark Developer to lead the migration of legacy SAS workflows to scalable PySpark solutions. The role focuses on modernizing data infrastructure and enabling advanced analytics across cloud platforms.

Responsibilities include reverse engineering SAS programs, building PySpark modules, and developing ETL pipelines with AWS and Snowflake. Collaboration with data scientists, analysts, and cloud engineers is essential for success.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3+ years of experience in SAS programming and data engineering.
• 2+ years of hands-on experience with PySpark and big data technologies.
• Strong understanding of data structures, algorithms, and performance tuning.
• Experience with cloud platforms (AWS, Azure, Snowflake) and distributed computing.

Responsibilities

• Analyze and reverse engineer existing SAS programs, macros, and data flows.
• Design and implement equivalent PySpark modules optimized for performance and scalability.
• Develop and maintain ETL pipelines using PySpark integrated with AWS, Snowflake/DataBricks.
• Validate migrated outputs against SAS baselines to ensure accuracy and consistency.
• Collaborate with cross-functional teams including data scientists, business analysts, and cloud engineers.
• Document technical specifications, migration strategies, and validation protocols.
• Participate in sprint planning, estimation, and delivery of migration milestones.

Skills

SAS programming

PySpark

Big data

Performance tuning

Cloud platforms

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

PySpark

AWS

Azure

Snowflake

Databricks

Job description

PySpark Developer

We are seeking a skilled and motivated SAS to PySpark Developer to lead the migration of legacy SAS-based analytics workflows to scalable PySpark solutions. This role is critical to modernizing our data infrastructure and enabling advanced analytics capabilities across cloud platforms.

Key Responsibilities

• Analyze and reverse engineer existing SAS programs, macros, and data flows.
• Design and implement equivalent PySpark modules optimized for performance and scalability.
• Develop and maintain ETL pipelines using PySpark integrated with AWS, Snowflake/DataBricks.
• Validate migrated outputs against SAS baselines to ensure accuracy and consistency.
• Collaborate with cross-functional teams including data scientists, business analysts, and cloud engineers.
• Document technical specifications, migration strategies, and validation protocols.
• Participate in sprint planning, estimation, and delivery of migration milestones.

Required Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• 3+ years of experience in SAS programming and data engineering.
• 2+ years of hands‑on experience with PySpark and big data technologies.
• Strong understanding of data structures, algorithms, and performance tuning.
• Experience with cloud platforms (AWS, Azure, Snowflake) and distributed computing.