Senior Python Data Engineer (AI & Data Migration) Job ID: JP054841

Itproposal; Brussel Hoofdstad; Sur place; EUR 90 000 - 130 000; Plein temps

Résumé du poste

Itproposal is seeking a Senior Python Data Engineer to drive migration of SAS-based ETL to a modern Python platform. You will design, build, and optimize AI-assisted data pipelines, focusing on scalable transformations with PyArrow, Parquet, Pandas, Polars, and Spark/PySpark.

Expect collaboration with SAS experts and architects to enable complex migration scenarios. You will review AI-generated Python code for performance and quality, implement robust testing, and contribute to automation

Qualifications

• 5+ years of experience in Python Data Engineering.
• Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
• Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
• Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
• Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
• Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.

Responsabilités

• Design, develop, and validate Python-based ETL and data transformation solutions.
• Review and optimize AI-generated Python code for performance, quality, and maintainability.
• Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark.
• Improve ETL/ELT processes, data quality, schema management, and performance.
• Contribute to AI-assisted software development and multi-agent orchestration workflows.
• Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
• Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
• Ensure robust testing, documentation, and operational reliability of migration solutions.

Connaissances

Python

Pandas

Polars

PyArrow

Parquet

Apache Spark/PySpark

ETL/ELT

AI-assisted development tools

Agentic workflows

Python performance tuning

Outils

GitHub Copilot

Testing frameworks

Description du poste

Senior Python Data Engineer (AI-Assisted Data Migration)

We are looking for a Senior Python Data Engineer to support the migration of legacy SAS-based ETL processes to a modern Python data platform using Parquet, PyArrow, Pandas, Polars, and Apache Spark. You will play a key role in developing AI-assisted migration solutions, optimizing agent-driven workflows, and ensuring high-quality, scalable data transformation processes.

Key Responsibilities

• Design, develop, and validate Python-based ETL and data transformation solutions.
• Review and optimize AI-generated Python code for performance, quality, and maintainability.
• Build and enhance data pipelines using Pandas, Polars, PyArrow, Parquet, and PySpark.
• Improve ETL/ELT processes, data quality, schema management, and performance.
• Contribute to AI-assisted software development and multi-agent orchestration workflows.
• Enhance workflow automation, validation processes, and human-in-the-loop quality assurance.
• Collaborate with architects, data engineers, and SAS experts to support complex migration scenarios.
• Ensure robust testing, documentation, and operational reliability of migration solutions.

Required Skills & Experience

• 5+ years of experience in Python Data Engineering.
• Strong expertise in Python, Pandas, Polars, PyArrow, Parquet, Apache Spark/PySpark, and Python performance tuning.
• Experience with ETL/ELT, data engineering, data quality, schema management, and testing frameworks.
• Experience using AI-assisted development tools (e.g., GitHub Copilot or similar).
• Knowledge of agentic workflows, multi-agent systems, workflow orchestration, and AI-driven automation.
• Familiarity with SAS Base (DATA Step, PROC SQL, Macros, ETL patterns) is a strong advantage.

Languages

• Active knowledge of Dutch, French, and English.

Location

• Brussels, Belgium
• Hybrid working model.