Senior Software Engineer (Python/Data Engineering)

Placements24; Riverton (UT); Hybrid; USD 54,000 - 91,000; Full time

Benefits offered by this job

Medical aid

Retirement benefits

Professional development

Hybrid work model

Job summary

Placements24 seeks an experienced Senior Software Engineer in Upington, SA, to build scalable data pipelines and data platforms using Python. You will optimize processing, model data, and support data-driven decisions in a hybrid work setup.

The role emphasizes data warehousing, collaboration with data scientists, and robust data governance across cloud platforms. A strong background in data engineering and SQL is essential.

Qualifications

• 5+ years of professional software engineering focused on data engineering.
• Strong Python development experience with data pipelines and data modeling.
• Expertise in SQL and relational databases (PostgreSQL/MySQL).
• Experience with data warehousing concepts and ETL/ELT processes.
• Familiarity with cloud data services (AWS/Azure/GCP).
• Version control with Git.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and related technologies.
• Build and optimize data processing jobs ensuring data quality and availability.
• Develop and manage data warehouses and data lakes with effective data modeling.
• Integrate data from multiple sources into a unified format.
• Collaborate with data scientists and analysts to meet data needs.
• Implement data security and governance best practices.
• Optimize database performance and query efficiency.
• Automate data-related tasks and resolve pipeline issues.
• Stay updated with emerging data engineering technologies.

Skills

Python

Data engineering

Pandas

NumPy

SQLAlchemy

SQL

PostgreSQL

MySQL

Git

Cloud platforms (AWS/Azure/GCP)

Education

Bachelor's degree in CS/Engineering/Data Science

Tools

Spark

Hadoop

Job description

About the Role

Our client, a rapidly growing analytics firm, is seeking a highly skilled Senior Software Engineer with a strong background in Python and Data Engineering. This role is based in **Upington, Northern Cape**, where you will be instrumental in building and maintaining scalable data pipelines, optimizing data processing, and developing robust data solutions. You will work with large datasets, implement data warehousing strategies, and ensure the efficiency and reliability of our client's data infrastructure. The ideal candidate will have extensive experience in Python development, data modeling, and cloud-based data platforms. This is an excellent opportunity to contribute to data-driven decision-making within a dynamic and forward-thinking organization located in **Upington, Northern Cape**, operating under a hybrid work model.

Key Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines using Python and related technologies.
• Build and optimize data processing jobs, ensuring data quality, integrity, and timely availability.
• Develop and manage data warehouses and data lakes, implementing effective data modeling techniques.
• Integrate data from various sources into a unified and accessible format.
• Collaborate with data scientists, analysts, and other engineers to understand data needs and deliver solutions.
• Implement data security and governance best practices.
• Optimize database performance and query efficiency.
• Automate data-related tasks and processes.
• Troubleshoot and resolve data pipeline issues and performance bottlenecks.
• Stay updated with emerging technologies in data engineering and big data.

Requirements

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field, or equivalent practical experience.
• 5+ years of professional experience in software engineering, with a strong focus on data engineering.
• Expertise in Python programming and its data-related libraries (e.g., Pandas, NumPy, SQLAlchemy).
• Strong experience with SQL and relational database systems (e.g., PostgreSQL, MySQL).
• Experience with big data technologies such as Apache Spark or Hadoop is a plus.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data warehousing concepts and ETL/ELT processes.
• Experience with version control systems (Git).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work effectively in a hybrid team environment based in **Upington, Northern Cape**.

Benefits

Our client offers a competitive salary, performance bonuses, comprehensive medical aid and retirement benefits, opportunities for professional development and training, and a collaborative work environment. This role provides a chance to work on impactful data projects and grow your career within an analytics-focused company.