Data Engineer

Salix Recruitment; Wes-Kaap; On-site; ZAR 500 000 - 600 000; Full time

Job summary

A leading recruitment firm is seeking an experienced Data Engineer to design and maintain data pipelines, ensuring data quality and accessibility. This role involves collaboration with teams to deliver data solutions for analytics and decision-making. The ideal candidate will have a strong background in data engineering, programming skills, and experience with big data technologies.

Qualifications

• 3-5 years of experience as a Data Engineer or in a related role.
• Proven experience in building and managing data pipelines.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures.
• Collaborate with data scientists and analysts to deliver solutions.
• Monitor and troubleshoot data workflows for system reliability.

Skills

Problem Solving

Communication

Education

Bachelor's degree in Computer Science

Matric (Grade 12)

Tools

Python

SQL

Hadoop

Spark

Kafka

AWS

Apache Airflow

Job description

Calling for an experienced Data Engineer within JHB!

Duties & Responsibilities

As a Data Engineer, you're the architect behind modern business, building the pipelines that transform raw data into actionable insights.

You design and optimize the systems that ensure data flows smoothly from diverse sources, overcoming challenges like bottlenecks and inconsistencies. Your work powers real-time analytics, AI models, and data-driven decisions, laying the foundation for growth and innovation.

Blending technical expertise and creativity, you tackle complex challenges ensuring data is accessible, reliable, and ready to answer critical questions. As a Data Engineer, you're at the core of the digital revolution, driving progress through the power of data.

Reach out to: Duties

• Design, develop, and maintain scalable data pipelines and architectures for big data processing.
• Integrate, consolidate, and optimize data from various structured and unstructured sources.
• Implement robust data quality controls, ensuring accuracy, consistency, and security of data.
• Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver solutions.
• Monitor and troubleshoot data workflows to ensure system reliability and performance.
• Develop and maintain databases, data lakes, and data warehouses using cloud and on-premises technologies.
• Document system processes, data flows, and technical specifications to ensure knowledge transfer.

Job Experience & Skills Required

Qualifications

• Matric (Grade 12)
• Bachelor's degree in Computer Science, Information Technology, Data Science, Business Analytics, or a related field.

Experience

• 3-5 years of experience as a Data Engineer or in a related role.
• Proven experience in building and managing data pipelines and data integration processes.
• Hands-on experience with data modeling, database design, and performance tuning.
• Exposure to real-time data processing and streaming platforms is a plus.
• Experience in implementing data security, governance, and compliance standards.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong expertise in SQL and database management systems (e.g., MySQL, PostgreSQL, Oracle).
• Experience with big data technologies like Hadoop, Spark, or Kafka.
• Familiarity with ETL tools and frameworks (e.g., Apache Airflow, Talend, Informatica).
• Knowledge of cloud data platforms (e.g., AWS Redshift, Azure Synapse, Google BigQuery).
• Strong problem-solving skills and ability to optimize complex data processes.
• Excellent communication and teamwork skills to collaborate with technical and non-technical stakeholders.

If you have not received a response in two weeks, please consider your application unsuccessful. Your profile will be kept on our database for any other suitable roles or positions.

Package & Remuneration

R 500,000 - R 600,000

Key Skills

Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala

Employment Type : Full-Time

Experience : 3-5 years

Vacancy : 1

Create a job alert for this search

Data Engineer • Central Karoo District Municipality, South Africa