Senior Python Data Engineer – AI-Powered Data Migration

Itproposal; Brussel Hoofdstad; Hybride; EUR 90 000 - 130 000; Plein temps

Résumé du poste

Itproposal is seeking a Senior Python Data Engineer to drive migration of SAS-based ETL to a modern Python platform. You will design, build, and optimize AI-assisted data pipelines, focusing on scalable transformations with PyArrow, Parquet, Pandas, Polars, and Spark/PySpark.

Expect collaboration with SAS experts and architects to enable complex migration scenarios. You will review AI-generated Python code for performance and quality, implement robust testing, and contribute to automation

Qualifications

• 5+ years of experience in Python Data Engineering.
• Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
• Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
• Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
• Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
• Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.

Responsabilités

• Design, develop, and validate Python-based ETL and data transformation solutions.
• Review and optimize AI-generated Python code for performance, quality, and maintainability.
• Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark.
• Improve ETL/ELT processes, data quality, schema management, and performance.
• Contribute to AI-assisted software development and multi-agent orchestration workflows.
• Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
• Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
• Ensure robust testing, documentation, and operational reliability of migration solutions.

Connaissances

Python

Pandas

Polars

PyArrow

Parquet

Apache Spark/PySpark

ETL/ELT

AI-assisted development tools

Agentic workflows

Python performance tuning

Outils

GitHub Copilot

Testing frameworks

Description du poste

Itproposal is seeking a Senior Python Data Engineer to drive migration of SAS-based ETL to a modern Python platform. You will design, build, and optimize AI-assisted data pipelines, focusing on scalable transformations with PyArrow, Parquet, Pandas, Polars, and Spark/PySpark.

Expect collaboration with SAS experts and architects to enable complex migration scenarios. You will review AI-generated Python code for performance and quality, implement robust testing, and contribute to automation