Senior Python Data Engineer - Spark & AI Agents

Software Guidance & Assistance, Inc. (SGA, Inc.); Tampa (FL); On-site; USD 110,000 - 160,000; Full time

Job summary

Software Guidance & Assistance, Inc. (SGA) seeks a Python Developer for a Right to Hire assignment in Tampa, FL.

The candidate will lead hands-on implementation and architecture of Python frameworks for scalable, resilient applications within the financial services domain. The role involves developing data pipelines with PySpark, Spark Core/SQL/Streaming, and Big Data stacks, while collaborating with Risk, Quants, FO, DevOps, and Production Support and adhering to SDLC standards to deliver

Qualifications

• Expert-level Python and PySpark for Spark applications.
• Experience with PySpark data processing and Pandas/NumPy.
• Strong SQL and complex query tuning.
• Knowledge of Spark Core/SQL/Streaming and Spark ecosystem.
• Familiarity with Hadoop, Kafka, HDFS, and YARN.
• Experience with NoSQL databases and HBase is a plus.

Responsibilities

• Lead hands-on implementation and architecture of Python frameworks for scalable, resilient, and performant applications.
• Develop solutions adhering to architectural standards, utilizing in-depth technical and business domain knowledge.
• Design and implement AI agent flows for reasoning, planning and tool utilization.
• Enforce SDLC best practices and contribute to code quality through reviews.
• Collaborate with Risk, Quants, FO, DevOps, and Production Support to ensure delivery.
• Drive development for Stress Testing and Regulatory Risk projects in Market Risk.
• Manage project technical aspects from conception to completion.
• Deliver high-quality solutions independently within a globally matrixed environment and under tight deadlines.

Skills

Python

PySpark

Spark Core

Spark SQL

Spark Streaming

Pandas

NumPy

SQL

Data Engineering

Automation

Tools

Spark GraphX

Hadoop

Kafka

HDFS

YARN

NoSQL

HBase

Job description

Software Guidance & Assistance, Inc. (SGA) seeks a Python Developer for a Right to Hire assignment in Tampa, FL.

The candidate will lead hands-on implementation and architecture of Python frameworks for scalable, resilient applications within the financial services domain. The role involves developing data pipelines with PySpark, Spark Core/SQL/Streaming, and Big Data stacks, while collaborating with Risk, Quants, FO, DevOps, and Production Support and adhering to SDLC standards to deliver