Senior Software Engineer (Python/Data Engineering)

Placements24; Upington; Hybrid; ZAR 900,000 - 1,200,000; Full time

Benefits offered by this job

Performance bonuses

Medical aid and retirement benefits

Professional development opportunities

Job summary

Placements24 is seeking a Senior Software Engineer in Upington, Northern Cape, to lead data engineering initiatives. You will design scalable Python data pipelines, optimize processing, and help build data warehousing solutions in a hybrid work environment.

The role collaborates with data scientists and engineers to deliver reliable data infrastructure and data-driven insights, maintaining security and governance across large datasets.

Qualifications

• Bachelor’s degree in CS, engineering, data science or related field.
• 5+ years in software engineering with a data engineering focus.
• Expertise in Python and data libraries (Pandas, NumPy, SQLAlchemy).
• Strong SQL experience with PostgreSQL or MySQL.
• Experience with Spark or Hadoop is a plus.
• Familiar with cloud platforms (AWS/Azure/GCP) and their data services.
• Knowledge of data warehousing and ETL/ELT processes.
• Version control with Git; strong problem-solving and communication.

Responsibilities

• Design and maintain scalable data pipelines in Python.
• Build and optimize data processing jobs with quality data.
• Develop data warehouses and data lakes with proper modeling.
• Integrate data from diverse sources into unified formats.
• Collaborate with data scientists and engineers.
• Implement data security and governance practices.
• Optimize database performance and queries.
• Automate data-related tasks and monitoring.
• Troubleshoot pipeline issues and bottlenecks.
• Stay updated on new data tech and platforms.

Skills

Python

Data Engineering

Pandas

NumPy

SQLAlchemy

SQL

PostgreSQL

MySQL

Spark

Hadoop

Cloud Platforms

ETL/ELT

Git

Data Modeling

Big Data

Communication

Education

Bachelor's degree in CS/Engineering/Data Science or related field

Tools

PostgreSQL

MySQL

Apache Spark

Hadoop

AWS

Azure

GCP

Git

SQLAlchemy

Pandas

NumPy

Job description

About the Role

Our client, a rapidly growing analytics firm, is seeking a highly skilled Senior Software Engineer with a strong background in Python and Data Engineering. This role is based in Upington, Northern Cape, where you will be instrumental in building and maintaining scalable data pipelines, optimizing data processing, and developing robust data solutions. You will work with large datasets, implement data warehousing strategies, and ensure the efficiency and reliability of our client's data infrastructure. The ideal candidate will have extensive experience in Python development, data modeling, and cloud-based data platforms. This is an excellent opportunity to contribute to data-driven decision-making within a dynamic and forward-thinking organization located in Upington, Northern Cape, operating under a hybrid work model.

Key Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines using Python and related technologies.
• Build and optimize data processing jobs, ensuring data quality, integrity, and timely availability.
• Develop and manage data warehouses and data lakes, implementing effective data modeling techniques.
• Integrate data from various sources into a unified and accessible format.
• Collaborate with data scientists, analysts, and other engineers to understand data needs and deliver solutions.
• Implement data security and governance best practices.
• Optimize database performance and query efficiency.
• Automate data-related tasks and processes.
• Troubleshoot and resolve data pipeline issues and performance bottlenecks.
• Stay updated with emerging technologies in data engineering and big data.

Requirements

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent practical experience.
• 5+ years of professional experience in software engineering, with a strong focus on data engineering.
• Expertise in Python programming and its data-related libraries (e.g., Pandas, NumPy, SQLAlchemy).
• Strong experience with SQL and relational database systems (e.g., PostgreSQL, MySQL).
• Experience with big data technologies such as Apache Spark or Hadoop is a plus.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data warehousing concepts and ETL/ELT processes.
• Experience with version control systems (Git).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work effectively in a hybrid team environment based in Upington, Northern Cape.

Benefits

• Our client offers a competitive salary, performance bonuses, comprehensive medical aid and retirement benefits, opportunities for professional development and training, and a collaborative work environment.

This role provides a chance to work on impactful data projects and grow your career within an analytics-focused company.