Data Engineer

To develop and maintain complete data architecture across several application platforms, providing capability across application platforms.

To design, build, operationalise, secure, and monitor data pipelines and data stores to applicable architecture solution designs, standards, policies, and governance requirements, thus making data accessible for the evaluation and optimisation for downstream use case consumption.

To execute data engineering duties according to standards, frameworks, and roadmaps.

Qualifications:

1. Type of Qualification: First Degree
2. Field of Study: Business Commerce, Information Studies, Information Technology
3. Experience Required: Experience in building databases, warehouses, reporting, and data integration solutions.
4. Experience building and optimising big data pipelines, architectures, and data sets.
5. Experience in creating and integrating APIs.
6. Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
7. Experience in database programming languages including SQL, PL/SQL, SPARK, and/or appropriate data tooling.
8. Experience with data pipeline and workflow management tools.
9. Understanding of data pipelining and performance optimisation, data principles, and how data fits in an organisation including customers, products, and transactional information.
10. Knowledge of integration patterns, styles, protocols, and systems theory.

Additional Information:

1. Adopting Practical Approaches
2. Articulating Information
3. Checking Things
4. Developing Expertise
5. Documenting Facts
6. Examining Information
7. Interpreting Data
8. Managing Tasks
9. Producing Output
10. Taking Action
11. Team Working

Key Skills:

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala

Vacancy: 1

Remote Work: Employment Type: