Data Engineer - Remote

EnableSA T/A EnableSA Pty Ltd; Gqeberha; Remote; ZAR 600,000 - 900,000; Full time

Job summary

EnableSA Pty Ltd is recruiting a Data Engineer for a remote position. The role focuses on designing data solutions using Azure services and building scalable data pipelines. You will collaborate with data scientists and stakeholders to meet data requirements while ensuring security and data quality.

Strong skills in SQL, Python, and Azure, plus experience with data warehousing and big data tooling, are essential for success in this remote capacity.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer, with experience in Azure.
• Strong understanding of data warehousing, data ingestion, and data processing concepts.
• Proficient in SQL, Python, Java, or C#.
• Knowledge of SQL variants (DAX, M) is a plus.
• Ability to work with large and complex data sets and perform data analysis and modelling.
• Experience with AWS or Google Cloud Platform.
• Knowledge of Hadoop or Spark.
• Experience with Power BI or Tableau.
• Knowledge of Agile development methodologies and DevOps practices.

Responsibilities

• Design and develop data solutions using Azure services (ADF, Lake, SQL).
• Implement data ingestion, processing, and storage solutions to meet business needs.
• Collaborate with data scientists and stakeholders to identify data requirements and design pipelines.
• Write efficient and scalable code for data processing and integration tasks.
• Implement data security and privacy measures to ensure data protection.
• Monitor and troubleshoot data processing issues and ensure data accuracy and quality.

Skills

SQL

Python

Java

C#

Azure Data Services

Data Modeling

Data Warehousing

Data Ingestion

DevOps

Agile

Power BI

Tableau

Big Data (Spark/Hadoop)

Education

Bachelor’s degree in Computer Science, Information Technology, or a related field

Tools

Azure Data Factory

Azure Data Lake

Azure SQL Database

AWS

Google Cloud Platform

Power BI

Tableau

Spark

Job description

Data Engineer (Remote)

This is a remote position.

Our national client is seeking an experienced Data Engineer (remote) to join the team:

1. Design and develop data solutions using Azure services, such as Azure Data Factory, Azure Data Lake, and Azure SQL Database.
2. Implement data ingestion, processing, and storage solutions to meet business needs.
3. Collaborate with data scientists and business stakeholders to identify data requirements and design data pipelines.
4. Write efficient and scalable code for data processing and data integration tasks.
5. Implement data security and privacy measures to ensure data protection.
6. Monitor and troubleshoot data processing issues and ensure data accuracy and quality.

Requirements

1. Bachelor’s degree in Computer Science, Information Technology, or a related field.
2. Proven experience as a Data Engineer, with experience in Azure.
3. Strong understanding of data warehousing, data ingestion, and data processing concepts.
4. Proficient in programming languages such as SQL, Python, Java, or C#.
5. Knowledge of SQL and experience with other query languages (e.g. DAX, M).
6. Ability to work with large and complex data sets and perform data analysis and modelling.
7. Experience with other cloud platforms, such as AWS or Google Cloud Platform.
8. Knowledge of big data technologies, such as Apache Hadoop or Apache Spark.
9. Experience with data visualization tools, such as PowerBI or Tableau.
10. Ability to write clean, efficient, and well-documented code.
11. Knowledge of Agile development methodologies and DevOps practices.