Senior Data Engineer - Data Engineering

DXC Luxoft; Kraków; On-site; PLN 180,000 - 240,000; Full time

Job summary

Luxoft is seeking an experienced Senior Data Engineer in Kraków to transform logs, events, telemetry, and other data into trusted datasets for observability and embedded analytics in the automotive sector.

You will design and operate production-grade pipelines, build data models, and enable analysis-ready datasets to improve troubleshooting and product quality in real-world conditions.

Qualifications

• Strong experience developing and operating production-grade data pipelines.
• Strong hands-on Python and SQL skills.
• Strong knowledge of data transformation and data modelling.
• Experience with cloud-based data solutions.
• Experience with data orchestration and automated workflows.
• Experience working with APIs, event data and logs.
• Experience with data quality and pipeline monitoring.
• Experience working with high-volume time-series and/or telemetry data.

Responsibilities

• Design, build and maintain production-grade data pipelines and transformations.
• Develop data models, schemas and curated datasets for different engineering use cases.
• Process logs, events, telemetry and high-volume time-series data.
• Integrate data from embedded, cloud, test and application sources using APIs and other interfaces.
• Implement automated data-quality checks and pipeline monitoring.
• Build analysis-ready datasets supporting troubleshooting and reliability analytics.
• Improve pipeline reliability, performance and maintainability.
• Support dashboards and analytical use cases.
• Document delivered solutions and support knowledge transfer.

Skills

Python

SQL

Data pipelines

Data modelling

Cloud data solutions

Data orchestration

APIs & event data

Data quality & monitoring

Time-series data

Job description

Project description

We are looking for an experienced Senior Data Engineer to join a project within observability and embedded analytics for a leading automotive Client.The project focuses on transforming logs, events, measurements and telemetry from embedded, cloud, test and application systems into trusted and reusable datasets and engineering insights.You will have a hands-on role in building production data pipelines, transformations and analysis-ready datasets that support faster troubleshooting, reliability analysis, product-quality follow-up and improved understanding of platform performance in real-world conditions.

Responsibilities

• Design, build and maintain production-grade data pipelines and transformations.
• Develop data models, schemas and curated datasets for different engineering use cases.
• Process logs, events, telemetry and high-volume time-series data.
• Integrate data from embedded, cloud, test and application sources using APIs and other data interfaces.
• Implement automated data-quality checks and pipeline monitoring.
• Build analysis-ready datasets supporting troubleshooting, reliability and product-quality analysis.
• Improve pipeline reliability, performance and maintainability.
• Support dashboards and analytical use cases.
• Document delivered solutions and support knowledge transfer.

SKILLS

Must have

• Strong experience developing and operating production-grade data pipelines.
• Strong hands-on Python and SQL skills.
• Strong knowledge of data transformation and data modelling.
• Experience with cloud-based data solutions.
• Experience with data orchestration and automated workflows.
• Experience working with APIs, event data and logs.
• Experience with data quality and pipeline monitoring.
• Experience working with high-volume time-series and/or telemetry data.

Nice to have

• Automotive or connected-car experience.
• Experience working with data from embedded systems or devices.
• Experience supporting troubleshooting, reliability or product-quality analytics.
• Experience with data visualisation and dashboards.
• Mobile analytics experience.
• Knowledge of data lineage and data governance.