Senior Data Engineer - Big Data Solutions

Placements24; LegKraal Gate; Híbrido; ZAR 900.000 - 1.200.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Health insurance

Dental insurance

Vision insurance

Remote work

Professional development

Paid time off

Retirement plan

Descripción de la vacante

Placements24 is seeking a Senior Data Engineer for a fully remote role with a leading data analytics client. You will design, build, and optimize large-scale data pipelines using Spark, Hadoop, and Kafka, enabling ML and advanced analytics across cloud platforms.

You will collaborate with data scientists, ensure data quality and security, develop data models, and implement warehousing/lake architectures on AWS, Azure, or GCP.

Formación

• Bachelor's degree in Computer Science, Engineering, Mathematics, or related field.

Responsabilidades

• Design, build, and maintain robust and scalable data pipelines.

Conocimientos

Data pipelines

Big data

Spark

Hadoop

Kafka

Python/Scala/Java

SQL

Cloud services

Data modeling

Educación

Bachelor's degree in CS/Engineering/Math

Herramientas

Apache Spark

Hadoop ecosystem

Snowflake

Redshift

BigQuery

AWS

Azure

GCP

Descripción del empleo

About the Role

Our client, a leader in data analytics and insights, is looking for a highly motivated and experienced Senior Data Engineer to join their fully remote team. This role is crucial for designing, building, and maintaining scalable data pipelines and infrastructure that enable advanced analytics and machine learning initiatives. You will work with large, complex datasets, transforming raw data into actionable insights that drive business decisions. The ideal candidate possesses a strong background in big data technologies, cloud platforms, and ETL/ELT processes. This is a fully remote position, offering the flexibility to work from anywhere while collaborating with a talented, distributed team of data professionals. You will play a key role in shaping our client's data strategy and infrastructure, ensuring data quality, accessibility, and reliability.

Key Responsibilities

• Design, build, and maintain robust and scalable data pipelines using tools like Apache Spark, Flink, or Kafka.
• Develop and optimize ETL/ELT processes for data ingestion, transformation, and loading into data warehouses or data lakes.
• Implement and manage data warehousing solutions (e.g., Snowflake, Redshift, BigQuery) and data lake architectures.
• Work with cloud platforms (AWS, Azure, GCP) and their associated data services.
• Ensure data quality, integrity, and reliability across all data systems.
• Collaborate with data scientists and analysts to understand their data needs and provide data solutions.
• Develop and maintain data models and schemas.
• Automate data processes and monitor pipeline performance.
• Stay current with emerging technologies and best practices in data engineering.
• Contribute to the continuous improvement of data infrastructure and processes.

Requirements

• Bachelor's degree in Computer Science, Engineering, Mathematics, or a related quantitative field.
• 5+ years of experience in data engineering or a related role.
• Proven experience with big data technologies such as Apache Spark, Hadoop ecosystem (HDFS, MapReduce), or similar.
• Strong proficiency in at least one programming language like Python, Scala, or Java.
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., S3, Blob Storage, GCS, EMR, Databricks, Data Factory).
• Solid understanding of SQL and database design principles.
• Experience with data warehousing concepts and tools.
• Familiarity with streaming data technologies (e.g., Kafka, Kinesis).
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and collaborate effectively in a remote team environment.
• Experience with data governance and security best practices is a plus.

Benefits

Our client offers a competitive salary, performance bonuses, and a comprehensive benefits package including health, dental, and vision insurance. This is a fully remote position, providing exceptional flexibility and work-life balance. We offer opportunities for professional development, including training, certifications, and conference attendance. Employees have access to leading-edge data technologies and tools. Our client fosters a collaborative and innovative remote work culture. Enjoy generous paid time off and retirement savings plans. Join a team dedicated to harnessing the power of data to drive innovation.