Data Engineer

Placements24; United States; Hybrid; USD 42,000 - 60,000; Full time

Benefits offered by this job

Health benefits

Retirement plan

Training & certs

Conference attendance

Hybrid work

Job summary

Placements24 is seeking a skilled Data Engineer to design, build, and maintain robust data pipelines and data infrastructure in a hybrid Randburg, Gauteng environment. You will support analytics and ML initiatives by ensuring data quality and accessibility for data scientists and analysts.

The role requires strong SQL, programming (Python/Scala/Java), ETL and data warehousing experience, with familiarity in Spark/Hadoop and cloud platforms (AWS/Azure/GCP).

Qualifications

• Proven experience as a Data Engineer or similar role with a portfolio of data solutions.
• Strong SQL and relational DB experience (PostgreSQL/MySQL/SQL Server).
• Experience with NoSQL databases (MongoDB/Cassandra) is a plus.
• Proficient in Python, Scala, or Java for data manipulation and pipelines.
• Experience with ETL and data warehousing concepts.
• Familiarity with big data tech (Spark/Hadoop).
• Cloud platform experience (AWS/Azure/GCP) and data services.
• Knowledge of data modeling techniques.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.

Responsibilities

• Design, build, and maintain scalable data pipelines for ingestion, transformation, and processing.
• Develop and optimize ETL processes with suitable tools.
• Build and manage data warehouses and data lakes with data integrity.
• Implement data quality checks and monitoring for accuracy.
• Collaborate with data scientists and analysts to meet data needs.
• Develop and maintain database schemas and performance tuning.
• Automate data processes to improve efficiency.
• Stay updated with emerging data technologies and best practices.
• Ensure data security and regulatory compliance.
• Contribute to architectural decisions on data infrastructure.

Skills

SQL

Relational databases

NoSQL databases

Python/Scala/Java

ETL processes

Data warehousing concepts

Spark/Hadoop

Cloud platforms (AWS/Azure/GCP)

Data modeling

Problem-solving

Communication & collaboration

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

PostgreSQL

MySQL

SQL Server

MongoDB

Cassandra

Spark

Hadoop

ETL tools

Job description

About the Role

Our client, a fast-growing analytics firm, is seeking a skilled and experienced Data Engineer to join their innovative team in Randburg, Gauteng . This hybrid role involves designing, building, and maintaining robust data pipelines and infrastructure that support the company's advanced analytics and machine learning initiatives. You will work with large datasets, implement data warehousing solutions, and ensure data quality and accessibility for data scientists and analysts. We are looking for individuals with a strong background in data architecture, ETL processes, and database management. The ideal candidate is passionate about data, efficient systems, and thrives in a collaborative environment where they can contribute to solving complex data challenges. This is an exciting opportunity to play a key role in shaping our client's data capabilities within the vibrant tech hub of Randburg, Gauteng .

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for data ingestion, transformation, and processing.
• Develop and optimize ETL (Extract, Transform, Load) processes using appropriate tools and technologies.
• Build and manage data warehouses and data lakes, ensuring data integrity and accessibility.
• Implement data quality checks and monitoring systems to ensure data accuracy and consistency.
• Collaborate with data scientists and analysts to understand their data needs and provide solutions.
• Develop and maintain database schemas and performance tuning strategies.
• Automate data processes to improve efficiency and reduce manual intervention.
• Stay current with emerging data technologies and best practices.
• Ensure data security and compliance with relevant regulations.
• Contribute to architectural decisions regarding data infrastructure.

Requirements

• Proven experience as a Data Engineer or in a similar role, with a strong portfolio of data solutions.
• Proficiency in SQL and experience with relational database systems (e.g., PostgreSQL, MySQL, SQL Server).
• Experience with NoSQL databases (e.g., MongoDB, Cassandra) is a plus.
• Strong programming skills in languages like Python, Scala, or Java for data manipulation and pipeline development.
• Experience with ETL tools and data warehousing concepts.
• Familiarity with big data technologies such as Spark, Hadoop, or related ecosystems.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data modeling techniques.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Bachelor's degree in Computer Science, Engineering, or a related quantitative field, or equivalent experience.

Benefits

Our client offers a competitive salary, comprehensive health benefits, a retirement savings plan, and significant opportunities for professional growth, including training, certifications, and conference attendance. This hybrid role offers a balance of in-office collaboration and remote work flexibility. You will work in a modern office environment in Randburg, Gauteng , with a team of dedicated professionals focused on leveraging data for business impact. We foster a culture of innovation, continuous learning, and career development.