PySpark Developer

Luxoft; Bengaluru; On-site; INR 3,000,000 - 5,500,000; Full time

Job summary

Luxoft is seeking a strong Senior Python Developer to work for a leading investment bank client in Bengaluru. The role focuses on data-intensive Python development, PySpark, and building robust data pipelines and APIs.

You will participate in full software development lifecycle, optimize performance, and mentor junior developers while adhering to coding standards and industry best practices.

Qualifications

• 10+ years of experience in data-intensive Python development.
• Proven core Python and PySpark development experience.
• Strong DB connectivity, loading, transformation, and calculations.
• Extensive experience with Pandas and NumPy dataframes.
• Familiarity with Lambda functions and decorators.
• Experience with Pandas dataframe operations (apply/map).
• Knowledge of data pipelines, concurrency, and error handling.
• Ability to translate business requirements into technical specs.
• Design experience for data pipeline architectures with concurrent processing.
• Familiarity with RESTful services and API design.
• Experience with unit testing and code reviews.

Responsibilities

• Develop software applications based on business requirements.
• Maintain software applications and enhance per project specs.
• Participate in requirement analysis, design, development, testing, and implementation activities.
• Propose new techniques and technologies for software development.
• Perform unit testing and user acceptance testing to evaluate functionality.
• Ensure completion of development tasks within deadlines.
• Work in compliance with coding standards and best practices.
• Provide assistance to junior developers when needed.
• Perform code reviews and recommend improvements.
• Review requirements and suggest changes to develop reliable applications.
• Develop coding documentation and other technical specifications.
• Act as primary contact for development queries and concerns.
• Analyze and resolve development issues accurately.

Skills

Core Python

PySpark

Pandas

NumPy

RESTful APIs

Concurrency

Data pipelines

Git

Unit testing

Data processing

Tools

Git

Job description

We need a Strong Senior Python Developer to work for a leading investment bank client.

Responsibilities

• :Develop software applications based on business requirement
• sMaintain software applications and make enhancements according to project specification
• sParticipate in requirement analysis, design, development, testing, and implementation activitie
• sPropose new techniques and technologies for software development
• .Perform unit testing and user acceptance testing to evaluate application functionalit
• yEnsure to complete the assigned development tasks within the deadline
• sWork in compliance with coding standards and best practice
• sProvide assistance to Junior Developers when needed
• .Perform code reviews and recommend improvements
• .Review business requirements and recommend changes to develop reliable applications
• .Develop coding documentation and other technical specifications for assigned projects
• .Act as primary contact for development queries and concerns
• .Analyze and resolve development issues accurately

Mandatory Skills Descriptio

• n:10+ years of experience in data intensive python developmen
• t.Proven experience as a core Python and Pyspark develope
• .Strong knowledge of DB connectivity, data loading , transformation, calculatio
• n.Extensive experience in Pandas/Numpy dataframes, slicing, data wrangling, aggregation
• s.Lambda Functions, Decorator
• s.Vector operations on Pandas dataframes /serie
• s.Application of applymap, apply, map function
• s.Concurrency and error handling data pipeline batch of size [1-10 gb
• ].Ability to understand business requirements and translate them into technical requirement
• s.Ability to design architecture of data pipeline for concurrent data processin
• g.Familiar with creating/designing RESTful services and API
• s.Familiar with application unit test
• s.Working with Git source control Service-orientated architecture, including the ability to consider integrations with other applications and service
• s.Debugging applicatio

Nice-to-Have Skills Descripti

• on:Knowledge of web backend technology - Django, Python, PostgreS
• lowAtlassian J
• iraUnderstanding of Financial Markets Asset Classes (FX, FI, Equities, Rates, Commodities & Credit), various trade types (OTC, exchange traded, Spot, Forward, Swap, Options) and related systems is a p
• lusSurveillance domain knowledge, regulations (MAR, MIFID, CAT, Dodd Frank) and related Systems knowledge is certainly a p