Senior Python & PySpark Data Platform Lead

Luxoft; Kraków; Hybrid; PLN 180,000 - 300,000; Full time

Job summary

Luxoft is seeking a senior Python developer to join our client's team and lead the build of a new data and application platform in the investment banking sector. You will design, develop, and maintain scalable back-end services and APIs using Python, PySpark, and Databricks.

You will implement CI/CD pipelines in Azure DevOps, mentor engineers, and collaborate with QA, product managers, and architects to ensure high-quality, business-aligned deliveries in a fast-paced environment.

Qualifications

• 8+ years of professional software development experience with Python.
• Strong hands-on Python development skills and PySpark experience.
• Experience designing, building, and maintaining ETL pipelines.
• Experience with Databricks and distributed data processing.
• Experience in automated testing of data pipelines and applications.
• Excellent problem-solving and communication skills.
• Familiarity with agile practices (Scrum/Kanban).
• Ability to translate business requirements into robust technical solutions.

Responsibilities

• Design, develop, and maintain scalable back-end services and APIs using Python.
• Build and optimize data pipelines and workloads on Databricks.
• Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps.
• Advise and guide the team on architecture, design decisions, and best practices for the new platform.
• Mentor developers and raise the technical level through code reviews and pair programming.
• Define and consume RESTful APIs and communicate requirements across teams.
• Translate business requirements into robust technical solutions.
• Apply clean code principles and contribute to engineering standards and tooling.
• Write and maintain automated tests (unit, integration).
• Participate in agile ceremonies (Scrum/Kanban) and collaborate with QA and product managers.
• Support and improve existing applications in a fast-paced enterprise environment.

Skills

Python

PySpark

Databricks

ETL pipelines

RESTful APIs

CI/CD

Azure DevOps

Code reviews

Pair programming

Agile methods

Tools

Databricks

Azure DevOps

Job description

Luxoft is seeking a senior Python developer to join our client's team and lead the build of a new data and application platform in the investment banking sector. You will design, develop, and maintain scalable back-end services and APIs using Python, PySpark, and Databricks.

You will implement CI/CD pipelines in Azure DevOps, mentor engineers, and collaborate with QA, product managers, and architects to ensure high-quality, business-aligned deliveries in a fast-paced environment.