About the Role
Our client, a leader in data-driven innovation within the Scientific Research & Development sector, is seeking an experienced Remote Principal Data Engineer . This is a fully remote position, accessible to professionals across South Africa . You will be responsible for designing, building, and maintaining scalable and robust data infrastructure on cloud platforms. This role is critical for enabling advanced analytics, machine learning, and data science initiatives by ensuring data is accessible, reliable, and performant. We are looking for a visionary leader who can architect complex data solutions, mentor junior engineers, and stay at the forefront of cloud data technologies. The ideal candidate possesses exceptional skills in distributed systems, ETL/ELT processes, and cloud data warehousing. You will work with a talented, distributed team, tackling challenging big data problems and driving the evolution of our data capabilities. This role offers significant autonomy and the opportunity to shape data strategy.
Key Responsibilities
- Design, develop, and optimize scalable data pipelines and ETL/ELT processes using cloud-native technologies.
- Architect and implement robust data warehousing solutions on major cloud platforms (AWS, Azure, GCP).
- Build and manage data infrastructure to support big data processing and analytics workloads.
- Ensure data quality, reliability, and security across all data systems.
- Collaborate with data scientists, analysts, and software engineers to understand data needs and deliver solutions.
- Develop and enforce data governance policies and best practices.
- Mentor and guide junior data engineers, fostering technical excellence within the team.
- Evaluate and implement new data technologies and tools to enhance data infrastructure.
- Automate data processes and implement monitoring and alerting systems.
- Troubleshoot and resolve complex data infrastructure issues.
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
- Minimum of 7 years of experience in data engineering, with a significant focus on cloud platforms.
- Proven expertise in designing and implementing large-scale data solutions on AWS, Azure, or GCP.
- Strong proficiency in programming languages such as Python, Scala, or Java.
- Extensive experience with SQL, data warehousing concepts, and MPP databases.
- Hands-on experience with big data technologies (e.g., Spark, Kafka, Hadoop ecosystem).
- Familiarity with data pipeline orchestration tools (e.g., Airflow, Prefect).
- Strong understanding of data modeling, data governance, and data security principles.
- Excellent problem-solving and analytical skills.
- Effective communication and leadership abilities in a remote setting.
- Must be legally authorized to work remotely within South Africa.
Benefits
- Our client provides a highly competitive salary, comprehensive health and wellness benefits, and the flexibility of a fully remote work environment across South Africa .
- A substantial budget is allocated for professional development, covering conferences, training courses, and certifications.
- You will have the opportunity to work on challenging, high-impact projects using state-of-the-art cloud technologies.
- We foster a collaborative remote culture, offer regular virtual team engagement, and provide ample paid time off.
- This role is ideal for a driven individual seeking to lead and innovate in cloud data engineering.