Remote Senior Data Engineer

Placements24; Soweto; Hybrid; ZAR 900,000 - 1,300,000; Full time

Benefits offered by this job

Competitive salary package and annual/

Job summary

Placements24 is seeking an experienced Senior Data Engineer to design, build and maintain scalable data infrastructure for the Oil & Gas sector in a fully remote role. This position focuses on delivering robust data platforms and analytics capabilities across large datasets.

You will develop ETL/ELT pipelines, manage data warehouses and data lakes, ensure data quality and security, and collaborate with data scientists and stakeholders to deliver analytics solutions.

Qualifications

• 6+ years of professional data engineering experience.
• Experience in Oil & Gas or complex data environments.
• Proficiency in Python, SQL, and Java.
• Experience with cloud platforms (AWS, Azure, GCP).
• Expertise in data warehouses, data lakes, ETL/ELT.
• Strong data modeling and architecture knowledge.
• Remote work capability and collaboration skills.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop ETL/ELT processes to integrate diverse sources.
• Ensure data quality, security, and accessibility.
• Collaborate with data scientists and stakeholders.
• Build data warehouses and data lakes.
• Monitor performance and optimize data systems.

Skills

Python

SQL

Java

Data modeling

Data architecture

ETL/ELT

Big data

Spark

Kafka

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Hadoop

Kafka

Job description

About the Role

Our client is looking for an experienced Senior Data Engineer to join their growing technology team in a fully remote capacity. This role is critical for designing, building, and maintaining scalable data infrastructure and pipelines that support advanced analytics and machine learning initiatives within the Oil & Gas industry . You will be responsible for ensuring data quality, accessibility, and efficiency across large datasets, enabling data scientists and analysts to derive actionable insights. This is an exceptional opportunity to contribute to a data-centric organization, shaping its data architecture and capabilities from anywhere.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines.
• Develop and optimize ETL/ELT processes to integrate data from various sources into a centralized data platform.
• Ensure data quality, integrity, and security across all data management systems.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and provide robust solutions.
• Build and maintain data warehousing solutions and data lakes.
• Monitor system performance, troubleshoot data-related issues, and implement performance improvements.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related quantitative field.
• 6+ years of professional experience in data engineering , with a strong background in the Oil & Gas sector or complex data environments.
• Proficiency in programming languages such as Python, SQL, and Java.
• Hands-on experience with cloud platforms (AWS, Azure, GCP) and big data technologies (e.g., Spark, Hadoop, Kafka).
• Experience designing and implementing data warehouses, data lakes, and ETL/ELT solutions.
• Strong understanding of data modeling, database design, and data architecture principles.
• Excellent problem-solving skills and ability to thrive in a remote, collaborative team setting.

Benefits

• Competitive salary package and annual performance bonus.
• Comprehensive health, dental, and vision insurance.
• 401(k) plan with company matching.
• Generous paid time off and professional development opportunities.
• A dynamic and challenging remote work environment focused on innovation and data excellence.