Senior Python & Spark Engineer: Credit Risk Pipelines

Software Guidance & Assistance, Inc. (SGA, Inc.); Tampa (FL); On-site; USD 120,000 - 160,000; Full time

Job summary

Software Guidance & Assistance, Inc. (SGA) is seeking a Python/Spark Developer for a right to hire engagement with a leading financial services client in Tampa, FL and Mississauga, ON.

The role focuses on building and optimizing large-scale data pipelines, credit risk analytics, and regulatory reporting, using Python, Spark, Hadoop, Hive, and related technologies. You will lead projects, drive CI/CD, and contribute to a fast-paced TechFin environment.

Qualifications

• 7+ years of software development with at least 5 years in Python and Apache Spark.
• Experience building backend applications and services using Python, not solely data engineering or analytics solutions.
• 3+ years of experience leading/owning software development projects from beginning to end with multiple team members.
• Experience working in financial market and credit risk enterprise software systems including scenario analysis and stress testing.
• Experience with GitHub, Tekton, Harness, and other CI/CD pipeline technologies.
• Ability to work in a fast-paced TechFin environment.
• Experience leveraging AI-assisted development tools such as GitHub Copilot, Claude, Devin, or similar technologies to improve engineering productivity.

Responsibilities

• Develop and optimize data pipelines for credit risk calculations and regulatory reporting.
• Design, build, optimize, and maintain scalable data pipelines for large-scale financial data.
• Lead projects for batch pipelines for credit risk analytics (GSST, CCAR, CECL, IFRS9, ICAAP).
• Ensure efficient storage and retrieval of risk data in Hadoop, Hive, Impala, Spark, etc.
• Implement Spark performance tuning including partitioning, caching, and memory management.
• Maintain code quality through CI/CD pipelines (Tekton, Harness) and version control (GitHub).

Skills

Python development

Apache Spark

Big data pipelines

Credit risk analytics

CI/CD pipelines

GitHub

AI-assisted development tools

Project leadership

Tools

Hadoop

Hive

Impala

Spark

Tekton

Harness

Job description

Software Guidance & Assistance, Inc. (SGA) is seeking a Python/Spark Developer for a right to hire engagement with a leading financial services client in Tampa, FL and Mississauga, ON.

The role focuses on building and optimizing large-scale data pipelines, credit risk analytics, and regulatory reporting, using Python, Spark, Hadoop, Hive, and related technologies. You will lead projects, drive CI/CD, and contribute to a fast-paced TechFin environment.