Senior Data Engineer (Big Data & Cloud) - Remote

Placements24; Upington; Ibrido; ZAR 1.000.000 - 1.300.000; Tempo pieno

Vantaggi offerti da questo lavoro

Competitive salary

Performance bonuses

Health & wellness benefits

Generous paid time off

Home office stipend

Descrizione del lavoro

Placements24 is seeking a Senior Data Engineer to design, build and maintain robust data pipelines and cloud-based data infrastructures. You will support data warehousing, BI and ML initiatives in a fully remote, distributed team, collaborating with data scientists and stakeholders.

Ideal candidates have strong programming skills, expertise in big data tech, and experience with AWS/Azure/GCP. The role emphasizes data quality, accessibility, and scalable architectures across South Africa.

Competenze

• Bachelor's degree or equivalent in CS/Engineering/IT.
• 5+ years of experience in data engineering.
• Proven experience designing scalable data pipelines with Spark/Hadoop/Kafka.
• Proficiency in SQL and various databases (relational & NoSQL).

Mansioni

• Design, build, install, test and maintain scalable data systems and pipelines.
• Develop and optimize ETL/ELT processes for data warehouses/data lakes.
• Build data architectures supporting analytics, ML workloads.
• Implement data governance, quality, and security standards.

Conoscenze

Big data

Spark

Hadoop

Kafka

SQL

NoSQL

Python/Scala/Java

Cloud platforms

Data warehousing

ETL/ELT

Formazione

Bachelor's degree in CS/Engineering/IT

Descrizione del lavoro

About the Role

Our client, a leading data analytics firm, is seeking a highly skilled Senior Data Engineer with expertise in big data technologies and cloud platforms to join their fully remote team. This role is crucial for designing, building, and maintaining robust data pipelines and infrastructure that support our data warehousing, business intelligence, and machine learning initiatives. You will be instrumental in ensuring the quality, accessibility, and efficiency of our data assets. The ideal candidate is passionate about data architecture, possesses strong programming skills, and thrives in a collaborative, distributed work environment. As a remote-first company, we prioritize clear communication and efficient asynchronous collaboration tools. This is an excellent opportunity to leverage your skills and contribute to impactful data solutions from anywhere within South Africa.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and data pipelines.
• Develop and optimize ETL/ELT processes to ingest data from various sources into data warehouses or data lakes.
• Build and maintain data architectures that support big data analytics, data science, and machine learning workloads.
• Implement data governance, quality, and security standards across all data solutions.
• Work with cloud platforms (AWS, Azure, GCP) to design and deploy scalable data infrastructure.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Develop and maintain data models and database schemas.
• Automate data processes and ensure the reliability and efficiency of data infrastructure.
• Monitor data systems for performance, troubleshoot issues, and implement optimizations.
• Stay current with emerging big data technologies and cloud services.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field, or equivalent practical experience.
• 5+ years of professional experience in data engineering or a related role, with a strong focus on big data technologies.
• Proven experience designing and building scalable data pipelines using tools such as Apache Spark, Hadoop, Kafka, or similar.
• Proficiency in SQL and experience with various database technologies (relational and NoSQL).
• Hands-on experience with at least one major cloud platform (AWS, Azure, GCP) and their data services (e.g., S3, Redshift, Azure Data Lake Storage, BigQuery).
• Strong programming skills in languages such as Python, Scala, or Java.
• Experience with data warehousing concepts and best practices.
• Familiarity with ETL/ELT tools and methodologies.
• Excellent problem-solving, analytical, and communication skills, essential for remote collaboration.
• Ability to work independently and manage project timelines effectively.

Benefits

• Our client offers a competitive salary, performance bonuses, comprehensive health and wellness benefits, generous paid time off, and a stipend for home office setup.

Enjoy the flexibility of remote work while being part of a forward-thinking, innovative team committed to data excellence across South Africa.