Senior PySpark Lead & Data Platform Architect

Luxoft; Wrocław; Vor Ort; PLN 260.000 - 360.000; Vollzeit

Zusammenfassung

Luxoft is seeking an experienced data engineer to develop and maintain data-intensive PySpark applications. You will contribute to requirement analysis, design, development, and testing, while ensuring performance optimization and adherence to coding standards. Strong leadership and collaboration with junior developers are essential.

The role emphasizes building scalable data pipelines, DS/AI integration, and technical documentation to support regulatory and business goals.

Qualifikationen

• 15+ years of data-intensive PySpark development experience.
• ],
• job_responsibilities_description":[

Aufgaben

• Develop software applications based on business requirements.
• Maintain software applications and implement enhancements per project specs.
• Participate in requirement analysis, design, development, testing, and deployment.

Kenntnisse

PySpark development

Python core

Spark architecture

Data engineering

Pandas/Numpy

DB connectivity

Concurrency

Git

Gen AI

OOP / design patterns

Data pipelines

Debugging

SOA integrations

Tools

Git

Apache Airflow

Django

PostgreSQL

Jira

Jobbeschreibung

Luxoft is seeking an experienced data engineer to develop and maintain data-intensive PySpark applications. You will contribute to requirement analysis, design, development, and testing, while ensuring performance optimization and adherence to coding standards. Strong leadership and collaboration with junior developers are essential.

The role emphasizes building scalable data pipelines, DS/AI integration, and technical documentation to support regulatory and business goals.