Aviation Data Engineer: Azure, Spark & Databricks

SmartRecruiters, Inc.; Warszawa; On-site; PLN 180,000 - 240,000; Full time

Job summary

Inetum Polska is hiring a Data Engineer to join an aviation-focused project. You will help build and scale a data platform that leverages Azure Databricks, Spark, Python, and SQL to support predictive maintenance and analytics for aircraft engines.

You’ll design pipelines, ensure data quality, and contribute to CI/CD efforts using Terraform and DABs. The role offers collaboration with an established engineering team and opportunities to work with modern cloud and big data technologies in a

Qualifications

• Commercial experience in Data Engineering.
• Hands-on experience with Databricks.
• Experience in implementing CI/CD for Databricks applications.
• Practical experience with Microsoft Azure data processing and storage services.
• Strong experience with Apache Spark.
• Good knowledge of SQL.
• Hands-on development experience with Python.
• Good understanding of Big Data processing concepts, standards, and tools.
• Experience working with large-scale data processing pipelines and ETL/ELT processes.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks, Apache Spark, Python, and SQL.
• Process and transform large volumes of operational and technical data supporting predictive maintenance and analytical use cases.
• Develop and optimize ETL/ELT processes for efficient data ingestion, transformation, and storage.
• Design and implement CI/CD processes for Databricks applications using Azure tooling, including Terraform and Databricks Asset Bundles (DABs).
• Work with Azure data processing and storage services to build reliable and scalable data solutions.
• Optimize Spark workloads and improve overall data processing performance.
• Implement data validation and quality checks to ensure consistency, accuracy, and reliability of datasets.
• Collaborate with Data Engineers and project stakeholders to translate business and data requirements into technical solutions.
• Contribute to the continuous development, maintenance, and improvement of the existing data platform.
• Troubleshoot data processing issues and improve the stability and performance of data pipelines.
• Prepare and maintain technical documentation for implemented solutions and data workflows.

Skills

Databricks

Azure

Apache Spark

Python

SQL

ETL/ELT

CI/CD

Big Data

Education

Bachelor's or Master's in Computer Science / Data Engineering

Tools

Terraform

Databricks Asset Bundles (DABs)

Job description

Inetum Polska is hiring a Data Engineer to join an aviation-focused project. You will help build and scale a data platform that leverages Azure Databricks, Spark, Python, and SQL to support predictive maintenance and analytics for aircraft engines.

You’ll design pipelines, ensure data quality, and contribute to CI/CD efforts using Terraform and DABs. The role offers collaboration with an established engineering team and opportunities to work with modern cloud and big data technologies in a