Senior Data Engineer

Pro Tem; Johannesburg; On-site; ZAR 200 000 - 300 000; Full time

Job summary

A leading data engineering firm in Johannesburg is seeking a Senior Data Engineer to lead the design and governance of a new Azure-based cloud data warehouse. You will manage stakeholder engagement, ensuring data solutions align with business needs and compliance requirements. The role includes mentoring junior engineers and leveraging strong technical expertise in data engineering, governance, and optimization. This position offers competitive compensation based on experience.

Qualifications

• 5+ years of experience in data engineering with a focus on data warehouse design and development.
• Strong hands-on expertise with SSIS and Azure data platform.
• Experience with Python or other scripting languages is preferred.

Responsibilities

• Lead the architectural design and implementation of the new Azure-based data warehouse.
• Own the data governance framework and ensure compliance.
• Mentor junior data engineers in technical best practices.

Skills

Data engineering

SQL (T-SQL preferred)

Data governance implementation

Data modelling (Kimball/Star/Snowflake)

Problem-solving skills

Education

Bachelor's degree in Computer Science or related field

Master's degree in Data Engineering or related discipline

Tools

SSIS

Azure Data platform

Python

Power BI

Git

Job description

To lead the design, development, and governance of the company’s enterprise data infrastructure, transitioning from the current SSIS-based ETL environment to a modern, scalable, Azure-based cloud data warehouse. This role is strategic and collaborative, requiring close engagement with business leaders, BI developers, analysts, and IT teams to ensure data solutions are business‑aligned, governance‑compliant, and ready for advanced analytics. As a senior member of the team, the role will mentor junior data engineers, influence architectural decisions, and champion best practices across the organisation.

Key Performance Areas

Data Warehouse Architecture & Leadership

• Lead the architectural design and implementation of the new Azure-based data warehouse.
• Oversee the optimisation of the existing SSIS-based ETL environment during the transition phase.
• Establish long‑term data platform strategy in collaboration with BI and IT leadership.

Data Governance & Compliance

• Own the data governance framework, ensuring standards for data quality, security, lineage, and access control are embedded in all solutions.
• Partner with compliance and legal teams to meet regulatory requirements for data storage and processing.
• Champion the use of data cataloguing and metadata management tools.

Collaboration & Stakeholder Engagement

• Work directly with senior stakeholders across business units to translate needs into actionable technical solutions.
• Serve as the primary point of contact between the BI team, engineering, and external vendors for data infrastructure matters.
• Facilitate workshops, architectural reviews, and cross‑team solution design sessions.

Technical Delivery & Mentorship

• Lead the build, testing, and deployment of robust ETL/ELT pipelines for multi‑source integration.
• Ensure smooth migration of historical and real‑time data to the new warehouse with minimal downtime.
• Mentor and support junior and mid‑level engineers in technical best practices and solution delivery.

Performance Monitoring & Continuous Improvement

• Implement platform monitoring solutions to track and optimise performance.
• Drive continuous improvement in architecture, tooling, and governance processes.

Minimum Requirements

• Education
  • Mandatory: Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field.
  • Preferred: Master’s degree in Data Engineering, Computer Science, or related discipline; Business Management or Project Management certification; Azure Data Engineer Associate or equivalent cloud certification; Data governance certification (DAMA, DCAM, or equivalent).
• Experience & Skills
  • Technical Experience
    • Mandatory: 5+ years in data engineering with experience in data warehouse design and development, strong hands‑on expertise with SSIS, proven Azure data platform knowledge, strong SQL (T‑SQL preferred), data governance implementation, data modelling (Kimball/Star/Snowflake), and performance tuning.
    • Preferred: Experience with Python or other scripting languages; knowledge of Azure Purview; knowledge of Azure DevOps and CI/CD pipelines; Power BI integration experience with Azure datasets.
  • Physical & Technical Competencies
    • Ability to design and optimize complex ETL/ELT workflows.
    • Strong understanding of data governance frameworks and compliance requirements.
    • Proficient in working with large‑scale data sets and high‑volume pipelines.
    • Strong problem‑solving skills focused on automation and efficiency.
    • Proficient in version control tools (e.g., Git).
    • Expertise in optimising data platforms for scale and performance.
    • Ability to manage competing priorities across multiple projects.
  • Behavioural Competencies
    • Highly collaborative, able to bridge business and technical teams.
    • Strong leadership and mentorship capabilities.
    • Exceptional English communication and stakeholder engagement skills.
    • Proactive, strategic thinker with a focus on delivering business value.
    • Adaptable in a fixed‑term, high‑delivery environment.

My client is willing to pay base on experience