Senior Data Engineer

Moyo; Pretoria; On-site; ZAR 700 000 - 900 000; Full time

Job summary

A leading South African consulting firm is looking for a Senior Data Engineer to develop robust data solutions. You will leverage your 8–10 years of experience to lead the technical vision and design modern data platforms. Proficiency in data engineering on Microsoft Azure, data integration, and strong analytical skills are required. Join us in driving significant changes in our clients' data capabilities.

Qualifications

• 8–10 years' experience as a Data Engineer or Database Developer.
• Proven experience in data mining and business requirements analysis.
• Hands-on experience with data integration and transformation.

Responsibilities

• Identify valuable data sources and automate data collection.
• Perform preprocessing of structured and unstructured data.
• Collaborate with engineering, product development, and business teams.

Skills

Data Engineering on Microsoft Azure

Data mining

Large-scale data modelling

Data integration and transformation

Hands-on experience with ETL/ELT tools

Database Management Systems

Big Data technologies

Statistical abilities

Education

Tertiary degree, diploma or certificate in a related field

Tools

SQL Server

Oracle

Azure Data Factory

Databricks

Power BI

Tableau

Job description

WELCOME TO MOYO Senior Data Engineer

We are searching for an experienced Senior Data Engineer to join us in driving significance together.

Primary Duties and Responsibilities

In this consulting role, you will play a key role in understanding our clients' business objectives and translating them into robust, scalable data solutions. You will lead the technical vision, guide architectural decisions, and ensure the successful design and delivery of modern data platforms that support and align with our clients' strategic goals.

Required Qualifications

• Tertiary degree, diploma or certificate in a related field (e.g. BSc Computer Science, B.IT, or Informatics).
• DP- : Data Engineering on Microsoft Azure – required
• DP- : Fabric Data Engineer Associate (Microsoft) – preferred
• Databricks Certified Data Engineer Associate – advantageous

Experience and Knowledge

• 8–10 years' experience as a Data Engineer or Database Developer.
• Proven experience in data mining, large‑scale data modelling, and business requirements analysis.
• Hands‑on experience with data integration and transformation processes.
• Implementation of data modelling methodologies such as Dimensional Modelling, Data Vault, and Lakehouse Design Principles.
• Working knowledge of data quality frameworks and Master Data Management (MDM).
• Proficient in using Database Management Systems (DBMS) such as SQL Server and Oracle.
• Skilled in designing and developing ETL/ELT pipelines using tools like SSIS, Azure Data Factory, Azure Synapse, Microsoft Fabric, and SQL Server stored procedures.
• Understanding of Big Data technologies such as Hadoop, MapReduce, and Spark; experience with event/message ingestion tools like Kafka, Event Hub, and Stream Analytics.
• Development experience in data languages such as T‑SQL, ANSI SQL, PL/SQL, and PySpark.
• Exposure to software development using Visual Basic, C++, C#, Java, or Python.
• Familiarity with tools like SQL Server Management Studio and Visual Studio/Visual Studio Code.
• Experience with Azure SQL, Azure Synapse, Microsoft Fabric, or Databricks.
• Additional skills in tools/languages such as Power BI, Tableau, Scala, R, Python, or strong mathematical/statistical abilities will be advantageous.

Key Responsibilities

• Identify valuable data sources and automate data collection.
• Perform preprocessing of both structured and unstructured data.
• Analyse large datasets to uncover trends and patterns.
• Execute data modelling using relational and star schema techniques.
• Design and develop relational databases and data warehouses / data lakehouses.
• Perform database administration and performance optimisation.
• Present insights using data visualisation tools and techniques.
• Propose data‑driven strategies and solutions to business challenges.
• Collaborate with engineering, product development, and business teams.
• Apply hands‑on experience with distributed storage and computing frameworks, including Hadoop and Spark.
• Support real‑time analytics and batch processing pipelines.
• Architect‑based analytical applications on platforms such as AWS and Azure.
• Implement CI/CD pipelines on data platforms.
• Design and manage ETL/ELT pipelines using notebooks or SQL.
• Build and monitor pipeline orchestration workflows.

Competencies

• Critical Thinking: Using logic and reasoning to identify strengths and weaknesses of alternative solutions.
• Active Learning: Understanding implications of new information for current and future problem‑solving.
• Systems Analysis: Determining how a system should work and how changes affect outcomes.
• Problem Solving: Identifying complex problems and evaluating options to implement solutions.
• Deductive Reasoning: Applying general rules to specific problems.
• Inductive Reasoning: Combining pieces of information to form general rules or conclusions.
• Excellent communication skills: Ability to engage with C‑level stakeholders and communicate a deep understanding of business and technology.
• Technical Literacy: High level of technical understanding to fit solutions into organizational structure.
• Analytical Assessment: Examining current systems to determine overall project needs and scope.
• Schedule Management: Time‑management skills to determine development schedules and milestones.
• Team Leadership: Overseeing and directing development teams throughout the project lifecycle.
• Strategic Project Translation: Ability to translate strategy and objectives into measurable projects.

Moyo Culture and Values

• We seek understanding.
• We make a difference.
• We’ve got your back.
• We are leaders.
• We are reliable.
• We are brave.