Senior Software Engineer

Luxoft; Gdańsk; On-site; PLN 300,000 - 420,000; Full time

Benefits offered by this job

Laptop and monitor equipment

Job summary

Luxoft in Gdańsk is seeking an experienced Senior Data/Software Engineer for the Surveillance Enhancement Program. You will develop and enhance a regulatory surveillance platform, focusing on data intensive PySpark workloads and UI/workflow improvements to meet MAR/Dodd-Frank obligations.

Responsibilities include design, development, testing, and optimization, mentoring juniors, and ensuring delivery within deadlines. Strong Python, PySpark, and data engineering skills are required.

Qualifications

• 10+ years of experience in data intensive PySpark development
• Experience leading a development team
• Proven experience as a Core Python developer
• Good understanding of Gen AI
• Strong knowledge of DB connectivity, data loading, transformation, calculation
• Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
• Vector operations on Pandas dataframes/series
• Apply/map functions usage
• Concurrency and error handling in data pipelines (1-10 GB batches)
• Ability to translate business requirements into technical designs
• Design data pipeline architectures for concurrent processing
• Experience with Git and SOA/integrations

Responsibilities

• Develop software applications based on business requirements
• Maintain and enhance applications per project specs
• Participate in requirements analysis, design, development, testing, and implementation
• Propose new techniques and technologies for software development
• Perform unit testing and UAT to verify functionality
• Complete development tasks within deadlines
• Adhere to coding standards and best practices
• Mentor junior developers as needed
• Review code and suggest improvements
• Refine requirements into reliable tech solutions
• Create coding documentation and technical specs
• Act as primary contact for development queries
• Analyze and resolve development issues accurately

Skills

Data-intensive PySpark

Window Functions

Performance Optimization

Spark Architecture

Salting

Column Pruning

Leading a Development Team

Core Python

Gen AI

DB Connectivity

Pandas/Numpy

Vector operations

Apply/Map Functions

Concurrency & Error Handling

Data Pipeline Architecture

Git

SOA/Integrations

Tools

Python

PySpark

Job description

The Surveillance Enhancement Program (SEP) is a multi-year initiative aimed at developing and improving the surveillance platform to identify potential market misconduct, manipulation, and abuse. Our client fulfilled its commitment to the Financial Conduct Authority (FCA) by meeting Market Abuse Regulation (MAR) requirements for critical data sources in September 2017.

Subsequent projects have been launched to further enhance, expand, and complement the existing automated surveillance platform. This project will focus on alert enhancements, strategic data sourcing from FM order and trade lakes, and user interface and workflow improvements to comply with regulatory obligations such as Market Abuse Regulation and Dodd-Frank.

Additionally, the scope includes enhancements related to Control Room and Suitability Monitoring data, interfaces, and scenarios.

Responsibilities:

• Develop software applications based on business requirements
• Maintain software applications and make enhancements according to project specifications
• Participate in requirement analysis, design, development, testing, and implementation activities
• Propose new techniques and technologies for software development.
• Perform unit testing and user acceptance testing to evaluate application functionality
• Ensure to complete the assigned development tasks within the deadlines
• Work in compliance with coding standards and best practices
• Provide assistance to Junior Developers when needed.
• Perform code reviews and recommend improvements.
• Review business requirements and recommend changes to develop reliable applications.
• Develop coding documentation and other technical specifications for assigned projects.
• Act as primary contact for development queries and concerns.
• Analyze and resolve development issues accurately.

Mandatory Skills Description:

• 10+ years of experience in data intensive Pyspark development ,Window Functions , Performance Optimization ,Spark Architecture,Salting ,Column Pruning
• Must have experience in leading a Development Team
• Proven experience as a Core Python developer
• Good understanding of Gen AI
• Strong knowledge of DB connectivity, data loading , transformation, calculation
• Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregations
• Vector operations on Pandas dataframes /series
• Application of apply map, apply, map functions
• Concurrency and error handling data pipeline batch of size [1-10 gb]
• Ability to understand business requirements and translate them into technical requirements
• Ability to design architecture of data pipeline for concurrent data processing
• Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and services

What do we offer our employees

• Equipment, such as a laptop and monitor