Hybrid Data Engineer: Build Scalable Pipelines & Data Lakes

Placements24; United States; Hybrid; USD 42,000 - 60,000; Full time

Benefits offered by this job

Health benefits

Retirement plan

Training & certs

Conference attendance

Hybrid work

Job summary

Placements24 is seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and data infrastructure in a hybrid Randburg, Gauteng environment. You will support analytics and ML initiatives by ensuring data quality and accessibility for data scientists and analysts.

The role requires strong SQL, programming (Python/Scala/Java), ETL and data warehousing experience, with familiarity in Spark/Hadoop and cloud platforms (AWS/Azure/GCP).

Qualifications

• Proven experience as a Data Engineer or similar role with a portfolio of data solutions.
• Strong SQL and relational DB experience (PostgreSQL/MySQL/SQL Server).
• Experience with NoSQL databases (MongoDB/Cassandra) is a plus.
• Proficient in Python, Scala, or Java for data manipulation and pipelines.
• Experience with ETL and data warehousing concepts.
• Familiarity with big data tech (Spark/Hadoop).
• Cloud platform experience (AWS/Azure/GCP) and data services.
• Knowledge of data modeling techniques.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.

Responsibilities

• Design, build, and maintain scalable data pipelines for ingestion, transformation, and processing.
• Develop and optimize ETL processes with suitable tools.
• Build and manage data warehouses and data lakes with data integrity.
• Implement data quality checks and monitoring for accuracy.
• Collaborate with data scientists and analysts to meet data needs.
• Develop and maintain database schemas and performance tuning.
• Automate data processes to improve efficiency.
• Stay updated with emerging data technologies and best practices.
• Ensure data security and regulatory compliance.
• Contribute to architectural decisions on data infrastructure.

Skills

SQL

Relational databases

NoSQL databases

Python/Scala/Java

ETL processes

Data warehousing concepts

Spark/Hadoop

Cloud platforms (AWS/Azure/GCP)

Data modeling

Problem-solving

Communication & collaboration

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

PostgreSQL

MySQL

SQL Server

MongoDB

Cassandra

Spark

Hadoop

ETL tools

Job description

Placements24 is seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and data infrastructure in a hybrid Randburg, Gauteng environment. You will support analytics and ML initiatives by ensuring data quality and accessibility for data scientists and analysts.

The role requires strong SQL, programming (Python/Scala/Java), ETL and data warehousing experience, with familiarity in Spark/Hadoop and cloud platforms (AWS/Azure/GCP).