Remote Senior Data Engineer

Placements24; Benoni; Hybrid; ZAR 900,000 - 1,400,000; Full time

Benefits offered by this job

Fully remote work arrangement

Challenging data projects

Continuous learning opportunities

Collaborative remote team culture

Job summary

Placements24 is seeking a Senior Data Engineer for a fully remote role. You will design, build, and maintain scalable data pipelines, data warehouses, and data lakes that power analytics and ML initiatives.

You'll collaborate with data scientists and analysts, implement ETL/ELT processes, ensure data quality and security, and mentor junior engineers in a distributed team. Remote-first setup with strong growth opportunities and competitive compensation.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related field.
• Extensive experience as a Data Engineer with large-scale data systems.
• Proficiency in SQL and experience with multiple DB technologies.
• Strong background in cloud data services and ETL/ELT tooling.

Responsibilities

• Design, construct, install, test, and maintain scalable data management systems and pipelines.
• Develop and implement complex ETL processes to ingest data from diverse sources.
• Build and optimize data warehouses and data lakes for analytics and reporting.
• Ensure data quality, integrity, and security across data systems.
• Collaborate with data scientists, analysts, and stakeholders to meet data needs.
• Implement monitoring and alerting for data pipelines and infrastructure.
• Optimize query performance and data processing efficiency.
• Evaluate new data technologies and tools to enhance infrastructure.
• Develop automation scripts for data engineering tasks.
• Mentor junior data engineers and share best practices.

Skills

SQL

Python

ETL

Data modeling

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

PostgreSQL

MySQL

Snowflake

BigQuery

Redshift

Spark

Hadoop

Kafka

Docker

Kubernetes

Job description

About the Role

Our client, a leading-edge data analytics firm dedicated to transforming raw data into actionable business intelligence, is looking for a highly experienced Senior Data Engineer to join their fully remote team. This role is pivotal in designing, building, and maintaining robust data pipelines and infrastructure that support advanced analytics and machine learning initiatives. You will work with massive datasets, implementing efficient data warehousing solutions, ETL processes, and ensuring data quality and accessibility. The ideal candidate possesses deep expertise in data engineering principles, cloud platforms, and big data technologies, coupled with a proactive approach to problem-solving and a passion for optimizing data systems. This is a remote-first opportunity, allowing you to excel from anywhere while contributing to impactful projects.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and data pipelines.
• Develop and implement complex ETL (Extract, Transform, Load) processes to ingest and integrate data from various sources.
• Build and optimize data warehouses and data lakes to support analytics and reporting needs.
• Ensure data quality, integrity, and security across all data systems.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Implement monitoring and alerting systems for data pipelines and infrastructure.
• Optimize query performance and data processing efficiency.
• Evaluate and recommend new data technologies and tools to enhance our data infrastructure.
• Develop automation scripts for data engineering tasks.
• Mentor junior data engineers and contribute to best practices within the team.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field, or equivalent practical experience.
• Extensive experience as a Data Engineer, with a proven track record of building and managing large-scale data systems.
• Proficiency in SQL and experience with various database technologies (e.g., PostgreSQL, MySQL, Snowflake, BigQuery, Redshift).
• Strong experience with big data technologies such as Apache Spark, Hadoop, Kafka, or similar.
• Proficiency in at least one programming language like Python, Scala, or Java for data manipulation and scripting.
• Hands-on experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Experience with data warehousing concepts and ETL/ELT tools.
• Familiarity with containerization technologies (Docker, Kubernetes) is a plus.
• Excellent problem-solving, analytical, and troubleshooting skills.
• Strong communication and collaboration skills, essential for a remote role.
• Previous experience working remotely or in a distributed team environment is highly valued.

Benefits

• Highly competitive salary and performance-based incentives.
• Fully remote work arrangement providing ultimate flexibility.
• Opportunity to work on challenging and large-scale data projects.
• Continuous learning opportunities and support for professional growth.
• Collaborative and supportive remote team culture.
• Be a key architect of data solutions for a forward-thinking company, potentially based near Benoni .