Senior Python & PySpark Data Engineer

Luxoft; Kraków; On-site; PLN 230,000 - 320,000; Full time

Job summary

Luxoft is seeking a senior Python developer to lead the build of a new data and application platform for an investment banking client. You will design scalable back-end services, APIs, and data pipelines using PySpark and Databricks within an agile environment.

You will mentor the team, drive CI/CD in Azure DevOps, and ensure high-quality automated tests and delivery. The role emphasizes clean code, architectural guidance, and collaboration with QA, product managers, and architects to align with

Qualifications

• At least 8 years of professional software development experience, including long-term projects.
• Strong hands-on Python development skills.
• Hands-on experience with PySpark and distributed data processing.
• Proven experience designing, building and maintaining ETL pipelines.
• Hands-on experience with Databricks.
• Experience in automated testing of data pipelines and applications.
• Clean coding skills.
• Excellent problem-solving skills.
• Good communication skills and the ability to state requirements clearly to other teams.

Responsibilities

• Design, develop, and maintain scalable back-end services and APIs using Python.
• Build and optimize data pipelines and workloads on Databricks.
• Design, implement, and maintain CI/CD pipelines and release processes in Azure DevOps.
• Advise and guide the team on architecture, design decisions, and best practices.
• Mentor developers and raise the technical level of the team through code reviews.
• Define and consume RESTful APIs, communicating requirements across teams.
• Translate business and product requirements into technical solutions.
• Apply clean code principles and improve engineering standards.
• Write and maintain automated tests (unit, integration).
• Participate actively in Scrum/Kanban ceremonies and planning.
• Work with QA, product managers, and architects for high-quality deliveries.
• Support and improve existing applications in a fast-paced enterprise environment.

Skills

Python

PySpark

ETL pipelines

Databricks

Automated testing

CI/CD

RESTful APIs

Clean coding

Agile

Problem solving

Tools

Azure DevOps

Unix/Linux

Autosys

SQL

Job description

Luxoft is seeking a senior Python developer to lead the build of a new data and application platform for an investment banking client. You will design scalable back-end services, APIs, and data pipelines using PySpark and Databricks within an agile environment.

You will mentor the team, drive CI/CD in Azure DevOps, and ensure high-quality automated tests and delivery. The role emphasizes clean code, architectural guidance, and collaboration with QA, product managers, and architects to align with