Hybrid Data Engineer for Big Data Platforms

Placements24; United States; Hybrid; USD 54,000 - 97,000; Full time

Benefits offered by this job

Medical aid contributions

Provident fund

Generous paid vacation time

Training programs

Industry conferences

Performance bonuses

Job summary

Placements24 is seeking an experienced Data Engineer to join a rapidly growing technology firm focused on data solutions in Paarl, Western Cape. You will design, develop, and maintain scalable big data platforms and data pipelines that ingest, transform, and store large volumes of data to enable analytics and machine learning initiatives.

The ideal candidate has hands-on experience with distributed systems, cloud data services, and programming languages such as Python, Scala, or Java.

Qualifications

• Bachelor’s degree in Computer Science or related field.
• Proven data engineering experience with big data tech.
• Strong SQL and database knowledge.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Develop data ingestion, transformation, and loading processes.
• Implement data warehousing and manage data storage systems.
• Ensure data quality, integrity and security across platforms.
• Collaborate with data scientists and engineers to meet data requirements.
• Monitor and troubleshoot pipeline performance; resolve issues.

Skills

SQL

Big data

Python

Scala

Java

Airflow

Education

Bachelor's degree in Computer Science/Engineering/IT

Tools

Apache Spark

Hadoop

Kafka

S3

BigQuery

Job description

Placements24 is seeking an experienced Data Engineer to join a rapidly growing technology firm focused on data solutions in Paarl, Western Cape. You will design, develop, and maintain scalable big data platforms and data pipelines that ingest, transform, and store large volumes of data to enable analytics and machine learning initiatives.

The ideal candidate has hands-on experience with distributed systems, cloud data services, and programming languages such as Python, Scala, or Java.