Data Engineer

Boardroom Appointments; Randburg; On-site; ZAR 420,000 - 660,000; Full time

Job summary

Boardroom Appointments is seeking a Data Engineer to develop data pipelines and ETL tools, and to contribute to BI reporting solutions. You will work across data architecture, warehousing, and data visualization, collaborating with DBAs and analysts to deliver reliable data for decision making.

The role requires a bachelor's degree in CS or related field, about five years in data engineering, and strong programming skills with SQL, RDBMS, and NoSQL databases; Hadoop experience is a plus.

Qualifications

• Bachelor's degree in Computer Science, Information Systems or related field.
• Five years of experience in data engineering and strong programming background.
• Experience with SQL, RDBMS and/or NoSQL databases preferred.

Responsibilities

• Supports design and implementation of data architecture, database design, system processing, and data warehousing.
• Designs new and innovative ways to create, manage, process and visualize data for successful analysis.
• Builds and implements datastores from data input to data output as part of a larger system.
• Works with database administrators (DBAs) on storing, analyzing, and transforming data for the business.
• Implements and maintains database designs and scripts that interact with other systems.
• Delivers data solutions through the use of advanced techniques and tools.
• Integration (Source & Target)
• Schedule Jobs
• Documentation (SoPs, Technical Docs)
• Deployment and monitoring

Skills

Data engineering

Programming

SQL

NoSQL

RDBMS

Education

Bachelor's degree in Computer Science, Information Systems or related field

Tools

SQL Server

MySQL

Hadoop

Job description

As a Data Engineer, you'll be responsible for the development of data pipelines and ETL tools. You will also be involved in all aspects of business intelligence including developing and implementing reporting solutions. You should have experience with SQL Server or similar databases, as well as an understanding of relational databases such as MySQL. Experience working with Hadoop is preferred but not required.

Duties and responsibilities:

• Supports the design and implementation of data architecture, database design, system processing, and data warehousing
• Designs new and innovative ways to create, manage, process and visualize data for successful analysis
• Builds and implements datastores from data input to data output as part of a larger system
• Works with database administrators (DBAs) on storing, analyzing, and transforming data for the business
• Implements and maintains database designs and scripts that interact with other systems.
• Delivers data solutions through the use of advanced techniques and tools
• Integration (Source & Target)
• Schedule Jobs
• Documentation (SoPs, Technical Docs)
• Deployment and monitoring

Qualifications and experience:

• Bachelors degree in Computer Science, Information Systems or related field required
• Experience with large scale systems and business applications a plus
• Five years of experience in data engineering and a strong background in computer programming
• Experience with SQL, RDBMS and/or NoSQL databases preferred