Data Engineer

Ao Connect Solutions; Pretoria; On-site; ZAR 600,000 - 900,000; Full time

Job summary

A leading company is seeking a highly skilled Data Engineer with AWS expertise to optimize data architecture and ensure seamless integration from diverse sources. Ideal candidates should have over 3 years experience, a passion for cloud platforms, and a collaborative spirit to drive business intelligence solutions effectively.

Qualifications

• 3+ years of experience as a Data Engineer.
• Experience with AWS data services and SQL proficiency.
• Understanding of data quality assurance and compliance.

Responsibilities

• Design, build, and maintain scalable data pipelines primarily on AWS.
• Ensure data quality, consistency, and reliability across environments.
• Collaborate with data analysts and stakeholders for solutions.

Skills

AWS data services

SQL

Python

ETL / ELT processes

Data integration

Tools

Git

Docker

Airflow

dbt

Job description

Get AI-powered advice on this job and more exclusive features. Direct message the job poster from AO Connect Solutions

About the Role

We're seeking a highly skilled Data Engineer with strong AWS expertise to join our growing team.

This is a key role where you'll be responsible for building and optimizing our data architecture, ensuring seamless data integration from multiple sources including Salesforce, GA4, BigQuery, Fullstory, and more.

You'll work with a dynamic and collaborative team to power business intelligence and analytics across the organization. This opportunity is ideal for a high-end intermediate to senior-level Data Engineer who is passionate about cloud data platforms, scalable pipelines, and making data accessible for decision-making.

Key Responsibilities

1. Design, build, and maintain scalable data pipelines and infrastructure primarily on AWS.
2. Integrate data from various sources including Salesforce, Google Analytics 4 (GA4), BigQuery, Fullstory, and other platforms.
3. Ensure data quality, consistency, and reliability across multiple environments.
4. Collaborate with data analysts, scientists, and business stakeholders to deliver robust data solutions.
5. Monitor performance and troubleshoot data pipeline issues.
6. Implement and maintain data security and compliance best practices.

Requirements

Technical Skills

• Strong experience with AWS data services (e.g., S3, Glue, Redshift, Lambda, Athena, EMR, etc.).
• Solid understanding of data integration and ETL / ELT processes.
• Proficiency in SQL and scripting languages such as Python or Scala.
• Experience working with Salesforce, GA4, BigQuery, and Fullstory data is a strong plus.
• Familiarity with version control tools like Git.

Experience

• 3+ years of experience as a Data Engineer (intermediate to senior level).
• Proven track record of delivering cloud-based data solutions at scale.

Nice to Have

• Experience with containerization (e.g., Docker).
• Familiarity with modern data orchestration tools (e.g., Airflow, dbt).
• Understanding of data governance and data privacy regulations.

Additional Details

Seniority level: Mid-Senior level

Employment type: Contract

Job function: Information Technology

Industries: Software Development

This job is no longer accepting applications / expired.