Data Engineer

Rifumo Empowerment Holdings; Gauteng; On-site; ZAR 334,800 - 558,000; Full time

Job summary

A data solutions company in Gauteng is seeking a skilled data engineer to build and optimize ETL pipelines while managing databases. Ideal candidates should possess a degree in IT or related fields and have experience with SQL and NoSQL databases. You will work in a dynamic environment focusing on data integration and quality assurance.

Qualifications

• Experience dealing with operation and application of electrical components.
• Previous experience in cabling and circuit design environment.
• Confidence with use and handling of common measurement instruments.

Responsibilities

• Build and maintain reliable ETL pipelines to process and store data.
• Optimize and manage databases including SQL and NoSQL.
• Integrate data from various sources ensuring quality and consistency.

Skills

Attention to Detail

Troubleshooting

Decision-making

Adaptability

Integrity

Initiative

Dependability

Organisation

Planning & Time Management

Education

Bachelor Degree or/and Diploma in Information Technology

Tools

Microsoft SQL Server

Office 365

Job description

Responsibilities

• Build, and maintain reliable and scalable ETL (Extract, Transform, Load) pipelines to process and store large amounts of structured and unstructured data
• Optimize and manage databases, including relational databases (SQL) and NoSQL databases (e.g., MongoDB, Cassandra)
• Integrate data from various internal and external sources, ensuring data quality and consistency
• Develop and maintain complex data models and schemas that meet business needs, including star and snowflake schema designs for data warehousing
• Design and implement data warehousing solutions, ensuring high performance, scalability, and availability
• Work with cloud platforms (e.g., AWS, Azure, GCP) to build and maintain cloud-based data infrastructure
• Automate repetitive data-related tasks, including data ingestion, validation, transformation, and storage
• Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
• Implement monitoring tools and troubleshoot any data pipeline or infrastructure issues to ensure data availability and integrity
• Combine raw information from different sources to create consistent and machine-readable formats
• Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling

Quality Assurance

• Perform quality assurance
• Constantly be on the lookout for ways to improve monitoring, discover issues and deliver better value to the customer
• Identify and mitigate risks associated with the project

Qualifications

• Bachelor Degree or/and Diploma in Information Technology, Informatics, Computer Science, Engineering, or a related field
• Previous experience in cabling and circuit design environment
• Experience dealing with operation and application of electrical components
• Confidence with use and handling of common measurement instruments
• Provision of quality customer service when required

Knowledge

• In-depth and thorough knowledge of learning machine methods
• Core application functionality and application technology stack
• Strong Office 365 skills: Excel, Word, Visio and PowerPoint
• Microsoft technologies such as Microsoft SQL Server, Microsoft Exchange Server, SharePoint Portal Server, Microsoft BizTalk Server
• Understanding of the Software Development Life Cycle
• Understanding of the customer's business processes

Skills & Abilities

• Attention to Detail: Must pay attention to detail and be thorough in completing tasks.
• Troubleshooting: Must be able to examine, test and resolve issues quickly, ensuring quick and proper rectification of problem areas.
• Decision-making: Must be able to utilize their professional knowledge and make decisions confidently.
• Adaptability: Must be comfortable working in a dynamic and fast-paced environment, able to adapt quickly to changing circumstances.
• Integrity: Must demonstrate high ethical standards and integrity in all financial dealings.
• Initiative: Must be willing to take on responsibilities and challenges.
• Dependability: Must be reliable, responsible, and dependable in fulfilling obligations.
• Organisation: Must be able to formulate and maintain system records and system designs.
• Planning & Time Management: Must be able to plan efficiently and manage time effectively.