Python/PySpark developer

Luxoft; Kraków; Hybrid; PLN 180,000 - 300,000; Full time

Job summary

Luxoft is seeking a senior Python developer to join our client's team and lead the build of a new data and application platform in the investment banking sector. You will design, develop, and maintain scalable back-end services and APIs using Python, PySpark, and Databricks.

You will implement CI/CD pipelines in Azure DevOps, mentor engineers, and collaborate with QA, product managers, and architects to ensure high-quality, business-aligned deliveries in a fast-paced environment.

Qualifications

• 8+ years of professional software development experience with Python.
• Strong hands-on Python development skills and PySpark experience.
• Experience designing, building, and maintaining ETL pipelines.
• Experience with Databricks and distributed data processing.
• Experience in automated testing of data pipelines and applications.
• Excellent problem-solving and communication skills.
• Familiarity with agile practices (Scrum/Kanban).
• Ability to translate business requirements into robust technical solutions.

Responsibilities

• Design, develop, and maintain scalable back-end services and APIs using Python.
• Build and optimize data pipelines and workloads on Databricks.
• Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps.
• Advise and guide the team on architecture, design decisions, and best practices for the new platform.
• Mentor developers and raise the technical level through code reviews and pair programming.
• Define and consume RESTful APIs and communicate requirements across teams.
• Translate business requirements into robust technical solutions.
• Apply clean code principles and contribute to engineering standards and tooling.
• Write and maintain automated tests (unit, integration).
• Participate in agile ceremonies (Scrum/Kanban) and collaborate with QA and product managers.
• Support and improve existing applications in a fast-paced enterprise environment.

Skills

Python

PySpark

Databricks

ETL pipelines

RESTful APIs

CI/CD

Azure DevOps

Code reviews

Pair programming

Agile methods

Tools

Databricks

Azure DevOps

Job description

Project description

We are looking for a senior Python developer to join our client's team and lead the build of a new data and application platform. The team focuses on clean code, agile methodologies, and high-quality delivery. The client is from the investment banking industry.

Responsibilities

• Design, develop, and maintain scalable back-end services and APIs using PythonBuild and optimize data pipelines and workloads on DatabricksDesign, implement, and maintain CI/CD pipelines and release processes in Azure DevOpsAdvise and guide the team on architecture, design decisions, and best practices while the new platform is builtMentor developers and raise the technical level of the team through code reviews and pair programmingDefine and consume RESTful APIs, clearly communicating requirements and constraints across teamsTranslate business and product requirements into robust technical solutionsApply clean code principles and contribute to continuous improvement of engineering standards and toolingWrite and maintain automated tests (unit, integration)Participate actively in agile ceremonies (Scrum/Kanban), including refinement, planning, reviews, and retrospectivesWork closely with QA, product managers, and architects to ensure high-quality, business-aligned deliveriesSupport and improve existing applications in a fast-paced, enterprise investment-banking environment

SKILLS

Must have

• At least 8 years of professional software development experience, including long-term projectsStrong hands-on Python development skillsHands-on experience with PySpark and distributed data processingProven experience designing, building and maintaining ETL pipelinesHands-on experience with DatabricksExperience in automated testing of data pipelines and applicationsClean coding skillsExcellent problem-solving skillsFamiliarity with agile practices (Scrum, Kanban, etc.)Good communication skills and the ability to state requirements clearly to other teams

Nice to have

Hands-on experience with Oracle, including strong SQL skills and query and performance tuningGood working knowledge of Unix/Linux and shell scriptingExperience scheduling and monitoring batch jobs with AutosysBackground in Java or C# development