Senior Python & PySpark Data Engineer - Databricks Platform

Luxoft Poland; Kraków; In loco; PLN 180.000 - 260.000; Tempo pieno

Descrizione del lavoro

Luxoft Poland is seeking a senior Python developer to join the client's team, leading the build of a data and application platform in a fast-paced investment-banking environment.

You will design, develop, and maintain backend services and data pipelines, guide architecture decisions, and mentor the team through code reviews and pairing. Strong PySpark, Databricks, and testing skills are required.

Competenze

• At least 8 years of professional software development experience.
• Hands-on experience with PySpark and distributed data processing.
• Proven experience designing, building and maintaining ETL pipelines.
• Hands-on experience with Databricks.
• Experience in automated testing of data pipelines and applications.
• Excellent problem-solving skills.
• Familiarity with agile practices (Scrum, Kanban).
• Good communication skills and the ability to state requirements clearly to other teams.

Mansioni

• Design, develop, and maintain scalable back-end services and APIs using Python.
• Build and optimize data pipelines and workloads on Databricks.
• Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps.
• Advise and guide the team on architecture, design decisions, and best practices while the new platform is built.
• Mentor developers and raise the technical level of the team through code reviews and pair programming.
• Define and consume RESTful APIs, clearly communicating requirements and constraints across teams.
• Translate business and product requirements into robust technical solutions.
• Apply clean code principles and contribute to continuous improvement of engineering standards and tooling.
• Write and maintain automated tests (unit, integration).
• Participate actively in agile ceremonies (Scrum/Kanban), including refinement, planning, reviews, and retrospectives.
• Work closely with QA, product managers, and architects to ensure high-quality, business-aligned deliveries.
• Support and improve existing applications in a fast-paced, enterprise investment-banking environment.

Conoscenze

Python

PySpark

Databricks

ETL pipelines

CI/CD pipelines

REST APIs

Automated testing

Agile practices

Unix/Linux

SQL

Strumenti

Oracle

Autosys

Shell scripting

Descrizione del lavoro

Luxoft Poland is seeking a senior Python developer to join the client's team, leading the build of a data and application platform in a fast-paced investment-banking environment.

You will design, develop, and maintain backend services and data pipelines, guide architecture decisions, and mentor the team through code reviews and pairing. Strong PySpark, Databricks, and testing skills are required.