Senior Data Engineer

Placements24; Vereeniging; On-site; ZAR 700,000 - 1,100,000; Full time

Benefits offered by this job

Competitive salary package and bonus

Comprehensive health, dental, and退休/RE

Opportunities for professional develop

Job summary

Placements24 is representing a prominent data analytics firm in Vereeniging, Gauteng, seeking a Senior Data Engineer. You will design, develop, and maintain scalable data pipelines and data warehouses to support BI and analytics initiatives.

Responsibilities include implementing ETL/ELT processes, ensuring data quality and governance, and collaborating with data scientists and software engineers using Spark, Hadoop, Python or Scala.

Qualifications

• Bachelor's degree in CS/Engineering/IT or related field.
• Minimum 5 years of data engineering experience.
• Experience designing and implementing ETL/ELT processes.
• Strong SQL and relational DB experience (PostgreSQL/MySQL/SQL Server).
• Experience with Spark and Hadoop ecosystems (HDFS, Hive).
• Proficiency in Python or Scala.
• Experience with data warehousing concepts and tools.
• Cloud familiarity (AWS, Azure, GCP) and data services.
• Knowledge of data modeling techniques.
• Excellent problem-solving and collaboration skills.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL processes.
• Develop and optimize data warehousing solutions for BI and analytics.
• Implement data quality checks and ensure data accuracy.
• Work with large datasets and distributed computing frameworks (Spark, Hadoop).
• Collaborate with data scientists and analysts to supply high-quality data.
• Optimize data retrieval and query performance.
• Develop and maintain data models for business objectives.
• Monitor data systems and implement reliability improvements.
• Implement and manage data governance policies.
• Stay current with emerging data engineering technologies.

Skills

Strong problem-solving and analytical

Excellent communication and teamwork

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or related quantitative field

Tools

Apache Spark

Hadoop

Python

SQL (PostgreSQL/MySQL/SQL Server)

Git

ETL/ELT pipelines

Job description

Our client, a prominent data analytics firm, is seeking a skilled Senior Data Engineer to contribute to the design, development, and maintenance of their scalable data infrastructure. This vital role, based in Vereeniging, Gauteng , involves working with large datasets, building robust data pipelines, and ensuring data quality and accessibility for various analytical and business intelligence needs. The ideal candidate will have a strong foundation in data warehousing, ETL processes, and distributed data processing technologies. You will collaborate with data scientists, analysts, and software engineers to empower data-driven decision-making across the organization. This is an exceptional opportunity to work with modern data technologies and significantly impact the company's data strategy.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines and ETL processes.
• Develop and optimize data warehousing solutions to support business intelligence and analytics needs.
• Implement data quality checks and ensure data accuracy, consistency, and completeness.
• Work with large datasets and distributed computing frameworks (e.g., Spark, Hadoop).
• Collaborate with data scientists and analysts to understand their data requirements and provide them with accessible, high-quality data.
• Optimize data retrieval and query performance.
• Develop and maintain data models to support business objectives.
• Monitor data systems for performance and issues, implementing solutions for optimization and reliability.
• Implement and manage data governance policies and procedures.
• Stay current with emerging data engineering technologies and best practices.
• Write efficient, maintainable, and well-documented code in languages like Python, SQL, or Scala.
• Contribute to the architectural decisions for the data platform.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
• Minimum of 5 years of professional experience in data engineering or a related role.
• Proven experience in designing and implementing ETL/ELT processes.
• Strong proficiency in SQL and experience with relational database management systems (e.g., PostgreSQL, MySQL, SQL Server).
• Experience with big data technologies such as Apache Spark, Hadoop ecosystem (HDFS, Hive).
• Proficiency in at least one programming language commonly used in data engineering, such as Python or Scala.
• Experience with data warehousing concepts and tools.
• Familiarity with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data modeling techniques.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Experience with version control systems (Git).

Benefits

• Competitive salary package and performance-based bonus.
• Comprehensive health, dental, and retirement benefits.
• Opportunities for professional development, training, and certifications.
• A collaborative work environment focused on innovation and data excellence in Vereeniging, Gauteng .
• Exposure to a wide range of modern data technologies.
• Generous paid time off and company holidays.