Senior PySpark & SQL Algorithm Engineer - Production

ACA Group; Durham (NC); On-site; USD 110,000 - 140,000; Full time

Job summary

ACA Group is looking for a Senior Algorithm Developer located in Durham, NC, to validate and optimize their PySpark-based surveillance platform. This role blends deep expertise in PySpark/Python and SQL with knowledge of financial markets and regulatory frameworks. The ideal candidate will have over 5 years of experience in software development, particularly in data processing systems. The position offers significant responsibilities in ensuring production quality and compliance with regulatory standards.

Qualifications

• 3+ years of hands-on PySpark/Python development in production environments.
• 5+ years of advanced SQL experience, including performance tuning.
• Strong AWS experience with S3, EMR, IAM, CloudWatch.

Responsibilities

• Validate and QA migrated surveillance algorithms by reconciling outputs.
• Optimize PySpark algorithms to meet processing SLAs across large data volumes.
• Enhance and develop new algorithms aligned to evolving regulatory requirements.

Skills

PySpark/Python development

Advanced SQL

Spark expertise

AWS

CI/CD and Git workflows

Financial instruments knowledge

Job description

ACA Group is looking for a Senior Algorithm Developer located in Durham, NC, to validate and optimize their PySpark-based surveillance platform. This role blends deep expertise in PySpark/Python and SQL with knowledge of financial markets and regulatory frameworks. The ideal candidate will have over 5 years of experience in software development, particularly in data processing systems. The position offers significant responsibilities in ensuring production quality and compliance with regulatory standards.