Senior data engineer

Network IT; Randburg; Hybrid; ZAR 900,000 - 1,500,000; Full time

Job summary

Network IT seeks a Senior Data Engineer at its Johannesburg branch to shape the organization’s data structure within a hybrid work setup.

You will collaborate with the Data Science Team to build enterprise ETL/ELT processes, work with Python, SQL (PostgreSQL) and AWS, and learn Snowflake/DBT. Mentorship and cross-team knowledge sharing are key parts of the role.

Qualifications

• Experience in building enterprise-grade ETL/ELT pipelines and data lakes.
• Proficient in Jira, Git and Agile development processes.
• Strong SQL skills with PostgreSQL experience.
• Experience with cloud data warehouses (Snowflake) and DBT.

Responsibilities

• Collaborate with teams to deliver objectives on time with high quality.
• Maintain up-to-date data infrastructure and data models.
• Provide iterative, working software and solutions regularly.
• Mentor team members and contribute to talent development.

Skills

ETL Pipelines

Data Lakes

Python

SQL

PostgreSQL

AWS Cloud

Snowflake

DBT

Dagster

Superset

Jira

Git

Big Data

Tools

Dagster

Superset

Jira

Git

Snowflake

Job description

Reference: NWA003388-Ren-1

A well-known marketing organization with branches in multiple overseas countries is looking for a Senior Data Engineer to join their organization at their Johannesburg branch. The Senior Data Engineer will be required to work on a hybrid module. Working within the Data Science Team, the Data Engineer will be responsible for the organization's data structure.

Duties & Responsibilities

Requirements:

• Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments.
• Experience in Agile development processes, using Jira, Git, etc.
• Working experience using multiple software development languages.
• Active working experience in Python, Bash/Shell Scripting, and SQL (PostgreSQL).
• Knowledge or willingness to learn Snowflake and DBT.
• Knowledge of Dagster and Superset would be an advantage.
• Experience in AWS Cloud infrastructure.
• Active working experience in Big Data is ideal.
• Experience in market research, marketing industries, and survey & sampling data would be beneficial.

Job & Description:

• Collaborate with multiple teams in order to deliver objectives on time and consistently maintain high quality.
• Ensure that projects are completed efficiently and effectively.
• Work iteratively delivering working software and solutions regularly.
• Sustain and ensure that the company's data infrastructure is always up-to-date and running efficiently.
• Participation in product and technology strategy discussions in order to provide valuable insights and assist with shaping the direction of the organization.
• Mentor and coach, and share your expertise and knowledge with other members of the team.
• Help to develop and retain top talent for the organization.

Apply now!