Senior Data Engineer: Build Scalable Data Pipelines

Optim-G Sourcing; Stellenbosch; On-site; ZAR 900,000 - 1,500,000; Full time

Job summary

Client name is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and data warehouses. The role will integrate data from SQL Server, PostgreSQL, and various accounting/CRM systems, ensuring reliable analytics readiness.

You will lead data product development, collaborate with IT and data architecture teams, and drive improvements in data reliability and quality. Strong Python and SQL skills are essential.

Qualifications

• Degree in a quantitative field (e.g. Information Systems, Computer Science, Mathematics, Statistics, or Finance).
• 8+ years relevant experience in data engineering or related roles.
• Proven experience in python-based data engineering projects.
• Strong proficiency in SQL and Python for data transformation and automation.
• Experience with data orchestration tools (e.g., Airflow).
• Excellent problem-solving and communication skills.

Responsibilities

• Design, build and maintain scalable data pipelines and warehouse solutions.
• Integrate transactional, accounting, and CRM data across multiple systems.
• Collaborate with data architects and IT teams on project goals.
• Develop data set processes for data modelling, mining and production.
• Create data products for advanced analytics and reporting.
• Install and update disaster recovery procedures.

Skills

Python

SQL

Data engineering

Education

Degree in a quantitative field

Tools

Airflow

Job description

Client name is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines and data warehouses. The role will integrate data from SQL Server, PostgreSQL, and various accounting/CRM systems, ensuring reliable analytics readiness.

You will lead data product development, collaborate with IT and data architecture teams, and drive improvements in data reliability and quality. Strong Python and SQL skills are essential.