Senior Data Engineer

RPO Recruitment; Johannesburg; Remote; ZAR 200,000 - 300,000; Full time

Job summary

A leading recruitment firm is seeking an experienced Senior Data Engineer based in Gauteng to enhance Microsoft's data infrastructure for real-time financial analytics. The ideal candidate has over 7 years of experience, strong skills in Azure services, and a passion for fintech innovation. This remote position offers a supportive environment for continuous learning and collaboration.

Benefits

Remote-first work environment

Continuous learning opportunities

Team collaboration events

Qualifications

• 7 years professional data engineering experience required.
• Experience in a senior role for at least 3 years.
• Strong problem-solving skills in Microsoft environments.

Responsibilities

• Maintain and optimize data infrastructure for financial analytics.
• Collaborate to translate business requirements into data solutions.
• Mentor junior data engineers on best practices.

Skills

Azure Data Factory

T-SQL

Azure Synapse Analytics

SQL Server Integration Services (SSIS)

Power BI

Azure Databricks

C# / .NET

Dimensional modelling

Education

BSc / BEng in Computer Science or Data Science

Tools

Azure DevOps

Git

Azure Monitor

Job description

Description

RPOs client is actively seeking a skilled Senior Data Engineer to join our client based in Gauteng remotely . This is an exciting opportunity for a dedicated data professional to elevate their career by building and optimizing Microsoft-based data infrastructure powering real-time financial analytics fraud detection and business intelligence systems. If you have extensive experience in data engineering within a Microsoft environment and a passion for fintech innovation we want to hear from you!

Responsibilities :

Maintain an understanding of the latest SQL features and programming practices through continuous learning.

Back up files from local directories to share and VSTS.

Identify problems uncovered by customer feedback and testing and correct or refer them to appropriate personnel.

Evaluate code to ensure it meets industry standards is valid properly structured and compatible with various Azure SQL versions.

Determine user needs by analysing technical requirements.

Manage data analysis and integration of disparate systems.

Ensure high quality and optimum performance of code delivered.

Follow internal standard guidelines.

Understand database operations and optimization for Microsoft SQL Server.

Develop reporting systems that provide accessible information for decision-making.

Conduct troubleshooting on code tables indexes and SQL server instances.

Generate and deliver quality reports to customers and perform quality assurance checks on reports.

Collaborate with various teams; translate business requirements into scalable data solutions.

Participate in design reviews and provide input on requirements product design and potential problems.

Test and prove that the software meets major architectural requirements.

Prove for scalability and performance of a software.

Ensure the quality of the system as a whole.

Stay up to date with the latest Microsoft data technologies Azure services and data engineering best practices.

Troubleshoot and optimize Azure data pipelines SQL Server performance and resolve data quality issues.

Continuously improve data infrastructure to reduce latency increase throughput and optimize Azure costs using FinOps principles.

Evaluate and integrate new Microsoft data tools and Azure services to enhance data platform capabilities.

Mentor and guide junior data engineers on the team.

Participate in architecture reviews and ensure all data solutions adhere to high-quality standards and best practices.

Communicate with stakeholders to understand data requirements and provide technical solutions.

Work independently and deliver high-quality work within tight deadlines.

Requirements :

BSc / BEng in Computer Science Data Science or comparable experience.

7 years professional data engineering experience 3 years in a senior / lead capacity.

7 years T-SQL / SQL Server expertise deep Azure Synapse Analytics skills C# / .NET for data processing applications.

Strong Azure Data Factory Azure Databricks SQL Server Integration Services (SSIS) Azure Stream Analytics Event Hubs.

Azure Synapse Analytics Power Designer for data modelling Azure DevOps for CI / CD.

Dimensional modelling with Power Designer SQL Server Data Tools (SSDT) schema design for OLAP / OLTP performance optimization.

Power BI integration SSAS / SSRS experience DAX / MDX knowledge semantic layer design.

Azure DevOps pipelines ARM templates / Bicep Azure Monitor Application Insights.

Unit testing for T-SQL and data pipelines data quality frameworks integration testing with Azure Data Factory.

Strong in basic DB concepts joins aggregate functions and commands (DDL DML TCL DCL) and help write and optimize in-application SQL statements.

Proficiency in advance SQL concepts like CTE Recursive queries Pivots Self joins Temporary functions UDF etc..

Deep understanding of relational database concepts with a solid knowledge of MS-SQL.

Proficiency with version control systems such as Git and Azure Repos.

Strong problem-solving and troubleshooting skills in Microsoft environments.

Experience with ETL tools.

Expertise in SQL Server performance tuning and optimization of large-scale data systems.

Good communication and leadership skills.

Advantageous Skills :

Azure Machine Learning and Azure Cognitive Services experience for ML pipelines.

Experience with Microsoft Fabric and its unified analytics platform.

Real-time analytics with Azure Stream Analytics and Complex Event Processing.

Azure Cost Management and FinOps experience optimizing data workloads.

Power Platform integration (Power Apps Power Automate) for data workflows.

Experience with Cosmos DB for multi-model database scenarios.

Microsoft Certified : Azure Data Engineer Associate or Azure Solutions Architect certification.

Benefits :

The opportunity to work on cutting-edge fintech solutions that make a real impact.

A remote-first work environment that values work-life balance.

Regular team get-togethers to foster collaboration and innovation.

Continuous learning opportunities in the fast-paced world of fintech.

A culture that encourages creativity hard work and pushing technological boundaries.

Contact RPO Recruitment for your next career opportunity.

Apply for this role today contact Justin Peach at or on LinkedIn.

You can also visit the RPO Recruitment website : or email us your CV : .

We will contact you telephonically in 3 days should you be suitable for this vacancy. If you are not suitable we will put your CV on file and contact you regarding any future vacancies that arise.

Package & Remuneration

Market Related

About Us

RPO is a Recruitment Specialist focused on providing recruitment solutions specifically tailored to our valued clients.

RPO focuses on select market segments namely Engineering Finance Supply Chain Manufacturing Information Technology and Mining.

With over 12 years of experience in the recruitment industry RPO has access to many high-caliber candidates across various industries all accessible through our highly trained and specialised recruiters. We focus on helping you reach your personal and professional goals by connecting you to bigger and better career paths.

Required Experience :

Senior IC

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1