Senior Data Engineer

Placements24; Polokwane; Hybrid; ZAR 900,000 - 1,700,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Health insurance

Home office allowance

Professional development

Cutting-edge data tech

Job summary

Placements24 seeks a Senior Data Engineer to join a fully remote data platform team. You will design, build, and maintain scalable data pipelines and infrastructure that support analytics and machine learning initiatives.

You will work with large datasets, implement robust data warehousing solutions, and ensure data quality and availability for various business units. This is an exciting opportunity for an experienced data professional who thrives in a remote-first environment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of professional experience in data engineering or a similar role.
• Strong proficiency in SQL and experience with PostgreSQL, Snowflake, Redshift.
• Expertise in Python or Scala for data processing.
• Experience with big data technologies and distributed computing frameworks (e.g., Spark, Hadoop).
• Familiarity with cloud data services (AWS, Azure, GCP) and orchestration tools (Airflow).

Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and data pipelines.
• Develop and optimize ETL/ELT processes to ingest data into data warehouse or data lake.
• Build and maintain robust data models to support BI and analytics.
• Ensure data quality, integrity, and security across data platforms.
• Collaborate with Data Scientists and Analysts to provide reliable data access.
• Monitor data systems for performance and availability, troubleshoot issues.

Skills

SQL

Python

Scala

Big data

Airflow

Education

Bachelor's or Master's degree in Computer Science/Engineering

Tools

PostgreSQL

Snowflake

Redshift

Spark

Hadoop

AWS

Azure

GCP

Airflow

Job description

About the Role

Our client is seeking a seasoned Senior Data Engineer to join their fully remote data platform team. This role is critical for designing, building, and maintaining scalable data pipelines and infrastructure that support analytics and machine learning initiatives. You will work with large datasets, implement robust data warehousing solutions, and ensure data quality and availability for various business units. This is an exciting opportunity for an experienced data professional who thrives in a remote-first environment, enjoys solving complex data challenges, and is passionate about enabling data-driven insights across the organization through efficient and reliable data systems.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and data pipelines.
• Develop and optimize ETL/ELT processes to ingest data from diverse sources into our data warehouse or data lake.
• Build and maintain robust data models to support business intelligence and analytical requirements.
• Ensure data quality, integrity, and security across all data platforms.
• Collaborate with Data Scientists and Analysts to understand their data needs and provide reliable data access.
• Monitor data systems for performance and availability, troubleshooting and resolving issues promptly.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of professional experience in data engineering or a similar role.
• Strong proficiency in SQL and experience with various database technologies (e.g., PostgreSQL, Snowflake, Redshift).
• Expertise in programming languages such as Python or Scala for data processing.
• Experience with big data technologies and distributed computing frameworks (e.g., Spark, Hadoop).
• Familiarity with cloud data services (AWS, Azure, GCP) and data pipeline orchestration tools (e.g., Airflow).

Benefits

• Highly competitive salary and performance bonuses.
• Fully remote work arrangement with flexible hours.
• Comprehensive health, dental, and vision insurance.
• Generous allowance for home office setup and professional development.
• Opportunity to work with cutting-edge data technologies and solve complex problems.