Data Engineer - Remote

Enablesa T / A Enablesa Pty Ltd; Gauteng; Remote; ZAR 600 000 - 800 000; Full time

Job summary

A leading data solutions company is seeking an experienced Data Engineer for a remote position. You will design and develop data solutions with Azure services, work on data ingestion and processing, and collaborate with data scientists. The ideal candidate has a Bachelor's degree in Computer Science or a related field and proven experience in Azure, strong skills in SQL, Python, and data modeling.

Qualifications

• Proven experience as a Data Engineer with experience in Azure.
• Strong understanding of data warehousing, data ingestion, and data processing concepts.
• Ability to work with large and complex data sets.

Responsibilities

• Design and develop data solutions using Azure services.
• Implement data ingestion, processing, and storage solutions.
• Collaborate with data scientists to identify data requirements.

Skills

Experience with Azure

SQL

Python

Data analysis and modeling

Big data technologies

Data visualization tools

Education

Bachelor's degree in Computer Science, IT, or related field

Tools

Azure Data Factory

PowerBI

Apache Spark

Job description

Job Overview

Data Engineer (Remote). This is a remote position. Our national client is seeking an experienced Data Engineer (remote) to join the team.

Responsibilities

• Design and develop data solutions using Azure services, such as Azure Data Factory, Azure Data Lake, and Azure SQL Database.
• Implement data ingestion, processing, and storage solutions to meet business needs.
• Collaborate with data scientists and business stakeholders to identify data requirements and design data pipelines.
• Write efficient and scalable code for data processing and data integration tasks.
• Implement data security and privacy measures to ensure data protection.
• Monitor and troubleshoot data processing issues and ensure data accuracy and quality.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with experience in Azure.
• Strong understanding of data warehousing, data ingestion, and data processing concepts.
• Proficient in programming languages such as SQL, Python, Java, or C#.
• Knowledge of SQL and experience with other query languages (e.g. DAX, M).
• Ability to work with large and complex data sets and perform data analysis and modelling.
• Experience with other cloud platforms, such as AWS or Google Cloud Platform.
• Knowledge of big data technologies, such as Apache Hadoop or Apache Spark.
• Experience with data visualization tools, such as PowerBI or Tableau.
• Ability to write clean, efficient, and well-documented code.
• Knowledge of Agile development methodologies and DevOps practices.