Data Engineer - Remote

Enablesa T / A Enablesa Pty Ltd; East London; Remote; ZAR 600 000 - 850 000; Full time

Job summary

A leading technology firm is seeking an experienced Data Engineer for a remote position. You will design and develop data solutions using Azure services, implement data ingestion processes, and collaborate with stakeholders. Candidates should have a Bachelor's degree in Computer Science or a related field, and proven experience with Azure and data processing concepts.

Qualifications

• Proven experience as a Data Engineer with Azure.
• Strong understanding of data warehousing and processing.
• Ability to work with large and complex data sets.

Responsibilities

• Design and develop data solutions using Azure services.
• Implement data ingestion and storage solutions.
• Collaborate with stakeholders to identify data requirements.
• Write efficient and scalable code for data processing.

Skills

Azure Data Factory

SQL

Python

Data modeling

Data analysis

Agile methodologies

Apache Spark

Education

Bachelor's degree in Computer Science

Information Technology or related field

Tools

Azure SQL Database

PowerBI

Job description

Job Overview

Data Engineer (Remote). This is a remote position. Our national client is seeking an experienced Data Engineer (remote) to join the team.

Responsibilities

• Design and develop data solutions using Azure services, such as Azure Data Factory, Azure Data Lake, and Azure SQL Database.
• Implement data ingestion, processing, and storage solutions to meet business needs.
• Collaborate with data scientists and business stakeholders to identify data requirements and design data pipelines.
• Write efficient and scalable code for data processing and data integration tasks.
• Implement data security and privacy measures to ensure data protection.
• Monitor and troubleshoot data processing issues and ensure data accuracy and quality.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with experience in Azure.
• Strong understanding of data warehousing, data ingestion, and data processing concepts.
• Proficient in programming languages such as SQL, Python, Java, or C#.
• Knowledge of SQL and experience with other query languages (e.g. DAX, M).
• Ability to work with large and complex data sets and perform data analysis and modelling.
• Experience with other cloud platforms, such as AWS or Google Cloud Platform.
• Knowledge of big data technologies, such as Apache Hadoop or Apache Spark.
• Experience with data visualization tools, such as PowerBI or Tableau.
• Ability to write clean, efficient, and well-documented code.
• Knowledge of Agile development methodologies and DevOps practices.