Data Engineer - Remote

Enablesa T / A Enablesa Pty Ltd; Secunda; Remote; ZAR 500 000 - 700 000; Full time

Job summary

A national tech firm is seeking an experienced Data Engineer for a remote position. The ideal candidate will design and develop data solutions using Azure services and collaborate with data professionals. Applicants must hold a degree in computer science and have proven Azure experience. This role emphasizes data protection compliance and effective troubleshooting of data processing issues.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field required.
• Proven experience as a Data Engineer with Azure is necessary.
• Knowledge of big data technologies, such as Apache Hadoop or Apache Spark.

Responsibilities

• Design and develop data solutions using Azure services.
• Implement data ingestion, processing and storage solutions.
• Collaborate with data scientists to identify data requirements.

Skills

Data warehouse concepts

Data ingestion skills

Programming in SQL

Programming in Python

Data visualization

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Data Factory

Azure SQL Database

PowerBI

Job description

Job Overview

Data Engineer (Remote). This is a remote position. Our national client is seeking an experienced Data Engineer (remote) to join the team.

Responsibilities

• Design and develop data solutions using Azure services, such as Azure Data Factory, Azure Data Lake, and Azure SQL Database.
• Implement data ingestion, processing, and storage solutions to meet business needs.
• Collaborate with data scientists and business stakeholders to identify data requirements and design data pipelines.
• Write efficient and scalable code for data processing and data integration tasks.
• Implement data security and privacy measures to ensure data protection.
• Monitor and troubleshoot data processing issues and ensure data accuracy and quality.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with experience in Azure.
• Strong understanding of data warehousing, data ingestion, and data processing concepts.
• Proficient in programming languages such as SQL, Python, Java, or C#.
• Knowledge of SQL and experience with other query languages (e.g. DAX, M).
• Ability to work with large and complex data sets and perform data analysis and modelling.
• Experience with other cloud platforms, such as AWS or Google Cloud Platform.
• Knowledge of big data technologies, such as Apache Hadoop or Apache Spark.
• Experience with data visualization tools, such as PowerBI or Tableau.
• Ability to write clean, efficient, and well-documented code.
• Knowledge of Agile development methodologies and DevOps practices.