Senior Data Engineer

Placements24; Centurion; Hybrid; ZAR 1,050,000 - 1,400,000; Full time

Benefits offered by this job

Highly competitive salary

Fully remote position

Health and wellness benefits

Learning and development resources

Challenging data projects

Job summary

Placements24 is seeking a Senior Data Engineer to join a fully remote data team. You will design and maintain scalable data pipelines, data warehouses, and data lakes, enabling advanced analytics and ML initiatives across diverse sources.

The role requires strong SQL, Python/Scala, and experience with Spark, Hadoop, and cloud platforms like Redshift, BigQuery, or Data Lake services. Collaboration in a distributed environment is essential.

Qualifications

• Bachelor's or Master's in a quantitative field.
• 5+ years in data engineering or related role.
• Strong SQL proficiency and data warehousing knowledge.
• Programming in Python or Scala for pipelines.

Responsibilities

• Design, build, and optimize scalable data pipelines for batch and real-time processing.
• Develop and maintain data warehousing and data lake solutions.
• Implement data quality frameworks and ensure data integrity.
• Collaborate with data scientists and analysts across teams.
• Optimize database performance and contribute to governance practices.

Skills

SQL proficiency

Python/Scala programming

Data pipeline design

Big data concepts

Education

Bachelor's or Master's degree in Computer Science or Statistics

Tools

SQL

Python

Scala

Spark

Hadoop

AWS Redshift

GCP BigQuery

Azure Data Lake

ETL/ELT tools

Job description

About the Role

Our client is seeking a proactive and skilled Senior Data Engineer to join their fully remote data team. This role is crucial for building and maintaining robust data pipelines and infrastructure that support advanced analytics and machine learning initiatives. You will work with large datasets, diverse data sources, and cutting-edge technologies to ensure data quality, accessibility, and performance. The ideal candidate is passionate about data, possesses strong programming skills, and thrives in a collaborative, distributed environment. This is an excellent opportunity to contribute to data-driven decision-making and to influence the future of data engineering at our client.

Key Responsibilities

• Design, build, and optimize scalable and reliable data pipelines for batch and real-time data processing.
• Develop and maintain data warehousing solutions and data lakes using cloud-based technologies.
• Implement data quality frameworks and ensure the integrity and accuracy of data across the organization.
• Collaborate with data scientists and analy...
• Optimize database performance and query efficiency.
• Contribute to the development of data governance policies and best practices.

Requirements

• Bachelor's or Master's degree in Computer Science, Statistics, or a related quantitative field.
• 5+ years of experience in data engineering or a similar role.
• Strong proficiency in SQL and experience with data warehousing concepts.
• Proficiency in programming languages such as Python or Scala for data manipulation and pipeline development.
• Hands-on experience with big data technologies (e.g., Spark, Hadoop) and cloud data platforms (e.g., AWS Redshift, GCP BigQuery, Azure Data Lake).
• Experience with ETL/ELT tools and data modeling techniques.

Benefits

• Highly competitive salary and potential for performance bonuses.
• This is a fully remote position , offering excellent work-life balance and flexibility.
• Comprehensive health and wellness benefits.
• Access to continuous learning resources and professional development opportunities.
• Opportunity to work on challenging and impactful data projects.
• A culture that fosters innovation, collaboration, and continuous improvement.