Senior Data Engineer

Level Up - Your Talent Partner; Johannesburg; Hybrid; ZAR 1,000,000 - 1,800,000; Full time

Benefits offered by this job

Hybrid work model

Courses/mentorship opportunities

Team events

Job summary

Level Up - Your Talent Partner is seeking a Senior Data Engineer to join a growing global technology environment. The role focuses on scalable data infrastructure, data integration and robust production systems.

You will work with engineers and data scientists to translate business needs into effective technical solutions. You will design pipelines, manage API-based data ingestion, apply SDLC best practices and own end-to-end projects while mentoring junior engineers in a collaborative, hybrid

Qualifications

• 7+ years of professional data engineering experience with ETL pipelines.
• Advanced Python for backend development and scripting.
• Strong SQL skills for relational databases.
• Experience with cloud platforms (AWS, GCP or Azure).
• Hands-on Docker/Kubernetes experience.
• Strong RESTful API understanding.
• Experience with version control (GitHub, GitLab or Bitbucket).
• Experience with CI/CD workflows.
• Solid SDLC knowledge and clean, maintainable code practices.
• Ability to own end-to-end projects and mentor junior engineers.

Responsibilities

• Design, develop, test and maintain reliable data pipelines and ETL processes using Python and SQL.
• Build API-based data ingestion workflows and real-time data integrations.
• Apply software engineering best practices, including modular design and documentation.
• Own and optimize data workflows and automation for efficiency and scalability.
• Collaborate with engineers, data scientists and stakeholders to translate business needs into technical solutions.
• Maintain data reliability, observability and error handling in production systems.
• Develop and support internal data-driven tools.
• Implement data ops practices including monitoring and alerting for pipeline health.
• Apply data DevOps principles, including CI/CD and IaC.

Skills

Python

SQL

Cloud platforms (AWS,GCP,Azure)

Docker

Kubernetes

REST APIs

Git/GitHub/GitLab/Bitbucket

CI/CD

SDLC & clean code

Mentoring juniors

Tools

Terraform

Job description

Our client is seeking an experienced Senior Data Engineer to join a growing engineering team within a global technology environment. The role will focus on building scalable data infrastructure, developing robust data integrations and improving the reliability and efficiency of production data systems. The successful candidate will work closely with engineers, data scientists and other stakeholders to translate business requirements into effective technical solutions.

Key Responsibilities

• Design, develop, test and maintain reliable data pipelines and ETL processes using Python and SQL.
• Build and manage API-based data ingestion workflows and real-time data integrations.
• Apply software engineering best practices, including modular design, testing, version control and documentation.
• Own and optimise data workflows and automation to support efficiency and scalability.
• Collaborate with senior engineers, data scientists and stakeholders to translate business needs into technical solutions.
• Maintain and enhance data reliability, observability and error handling within production systems.
• Develop and support internal data-driven tools.
• Implement data operations best practices, including automated monitoring, alerting and incident response for pipeline health.
• Apply data DevOps principles, including CI/CD for data workflows, infrastructure-as-code and containerised ETL deployments.
• Take ownership of projects from end to end and support the development of junior engineers through mentoring.

Minimum Requirements

• At least 7 years of professional experience as a Data Engineer or in a similar role developing data ETL pipelines.
• Advanced proficiency in Python for backend development and scripting.
• Strong SQL skills with practical experience querying and modelling relational databases.
• Experience working with cloud platforms such as AWS, GCP or Azure.
• Hands-on experience with containerisation technologies such as Docker or Kubernetes.
• Solid understanding of RESTful APIs.
• Experience with version control systems such as GitHub, GitLab or Bitbucket.
• Experience working with CI/CD workflows.
• Strong understanding of the software development lifecycle (SDLC) and principles of clean, maintainable code.
• Demonstrated ability to work independently and take ownership of projects from end to end.
• Experience mentoring junior engineers.

Advantageous Experience

• Familiarity with AI concepts and prompt engineering.
• Experience with data security, privacy compliance and access controls.
• Knowledge of infrastructure-as-code tools such as Terraform or Helm.
• Experience with event-driven architecture or stream processing.

Key Competencies

• Strong technical problem-solving ability.
• Ability to work independently and take ownership of complex technical work.
• Effective collaboration across technical and business teams.
• Commitment to building reliable, maintainable and scalable data solutions.

Additional Information

• Hybrid working model.
• Access to courses, conferences and mentorship opportunities to support professional development.
• Supportive and collaborative working environment.
• Access to a workplace relaxation room.
• Team events, social gatherings and celebrations.
• A culture that recognises personal and family priorities.