Azure Data Engineer

Datafin IT Recruitment; Johannesburg; On-site; ZAR 600,000 - 800,000; Full time

Job summary

A leading tech recruitment firm seeks an Azure Data Engineer to build and maintain scalable data pipelines in Microsoft Azure. Responsibilities include designing data architectures, performing ETL development, and ensuring data governance. Ideal candidates have over 3 years of data engineering experience and strong Azure service skills. This role is based in Johannesburg, South Africa.

Qualifications

• 3+ years experience in data engineering or related field.
• Strong experience with Azure cloud services, particularly Azure Data Factory.
• Familiarity with version control (Git) and DevOps.

Responsibilities

• Develop and maintain data pipelines using Azure technologies.
• Design and implement data storage solutions.
• Optimize data solutions for performance and cost.

Skills

Azure Data Factory

SQL

Python

Data Modeling

Data Warehousing

Education

Bachelors degree in Computer Science, Information Systems, Engineering or a related field

Tools

Azure Databricks

Azure Synapse Analytics

Git

Power BI

Job description

ENVIRONMENT

AN innovative robotics and AI company seeks an Azure Data Engineer to join their team. The Azure Data Engineer is responsible for building and maintaining scalable data pipelines and solutions in Microsoft Azure. You will design, implement, and optimize data architectures and services that enable data-driven decision-making across the organization.

DUTIES

• Develop and maintain data pipelines using Azure Data Factory, Databricks, Synapse, etc.
• Design and implement data storage solutions using Azure Data Lake, Azure SQL DB, and Cosmos DB.
• Create and maintain data models and data warehouses.
• Perform ETL / ELT development and ensure data integrity and consistency.
• Work with stakeholders to understand data requirements and translate them into technical solutions.
• Optimize data solutions for performance, cost, and scalability.
• Implement CI / CD pipelines for data workflows.
• Ensure data governance, security, and compliance standards are met.

REQUIREMENTS

• 3+ years experience in data engineering or related field.
• Strong experience with Azure cloud services, especially : Azure Data Factory
• Azure Databricks
• Azure Synapse Analytics
• Azure Data Lake
• Proficiency in SQL, Python, or Scala.
• Knowledge of data modeling, data warehousing, and distributed systems.
• Experience with version control (Git), DevOps, and CI / CD pipelines.
• Familiarity with Power BI is a plus.

QUALIFICATIONS

• Bachelors degree in Computer Science, Information Systems, Engineering or a related field.
• Azure certifications preferred