Senior Data Engineer - Data Platform Engineering

Luxoft; Kraków; Hybrid; PLN 120,000 - 180,000; Full time

Job summary

Luxoft is seeking a Senior Data Engineer specializing in Data Platform Engineering to join a project focused on observability and embedded analytics for a leading automotive client. The role aims to build a scalable and maintainable data foundation that transforms logs, events, measurements and telemetry into trusted data products.

You will architect and engineer data pipelines, orchestration, common data models, data quality and monitoring, while integrating data from varied sources and

Qualifications

• Proven experience building production-grade data platforms and pipelines.
• Strong Python and SQL proficiency.
• Experience with cloud-based data solutions.
• Knowledge of data modelling, schemas and transformations.

Responsibilities

• Design and implement the target data architecture and production data foundation.
• Build and maintain robust, automated data pipelines and transformations.
• Develop shared data models, schemas and analysis-ready datasets; implement data orchestration, data-quality controls, monitoring and lineage.
• Integrate data from embedded, cloud, test and application systems using APIs and other data interfaces.
• Improve platform reliability, scalability, performance and maintainability.
• Support analytical use cases while keeping the underlying data platform reusable.
• Produce operational documentation and support knowledge transfer to Client teams.

Skills

Data platform design

Python

SQL

Cloud data solutions

Data modelling

Data orchestration

APIs integration

Data quality & observability

Job description

Project description

We are looking for a Senior Data Engineer specialising in Data Platform Engineering to join a project focused on observability and embedded analytics for a leading automotive Client.The project aims to establish a scalable and maintainable data foundation that transforms logs, events, measurements and telemetry from embedded, cloud, test and application systems into trusted and reusable data products.In this role, you will focus on the architecture and engineering of the data platform, including pipelines, orchestration, common data models, data quality and operational monitoring.

Responsibilities

• Design and implement the target data architecture and production data foundation.
• Build and maintain robust, automated data pipelines and transformations.
• Develop shared data models, schemas and analysis-ready datasets. Implement data orchestration, data-quality controls, monitoring and lineage.
• Integrate data from embedded, cloud, test and application systems using APIs and other data interfaces.
• Improve platform reliability, scalability, performance and maintainability.
• Support analytical use cases while keeping the underlying data platform reusable.
• Produce operational documentation and support knowledge transfer to Client teams.

SKILLS

Must have

• Strong experience designing and operating production-grade data platforms and pipelines.
• Strong Python and SQL skills.
• Experience with cloud-based data solutions.
• Strong knowledge of data modelling, schemas and transformations.
• Experience with data orchestration and automated workflows.
• Experience integrating systems through APIs.
• Experience with data quality, pipeline monitoring and observability.

Nice to have

• Automotive connected-car or embedded-systems experience.
• Experience with telemetry, event and time-series data.
• Data lineage and governance experience.
• Experience supporting dashboards and analytical platforms.
• Experience optimising data platforms for performance and cost.