Data Engineer

IQbusiness; Gauteng; Hybrid; ZAR 600,000 - 850,000; Full time

Job summary

A leading company is seeking an experienced Data Engineer (AWS Specialist) to enhance their data architecture and enable data-driven insights. The role offers the flexibility of hybrid or remote work and involves designing durable data pipelines while ensuring data quality and security across platforms like AWS, Salesforce, and BigQuery.

Qualifications

• Proven experience as a Data Engineer.
• Strong AWS background and experience with data pipelines.
• Understanding of data governance and cloud best practices.

Responsibilities

• Design, develop, and maintain scalable data pipelines in AWS.
• Optimize data flow and ETL processes for performance.
• Collaborate with teams to deliver end-to-end data solutions.

Skills

AWS expertise

SQL

Data integration

Python

Data governance

Tools

AWS Glue

AWS Lambda

AWS S3

AWS Redshift

AWS CDK

Job description

Job Title: Data Engineer (AWS Specialist)
Location: Hybrid or Remote
Contract Type: Contract

About the Role:
We are looking for an experienced Data Engineer with a strong AWS background to join our team. This role will focus on designing, building, and maintaining robust data pipelines and integrations across multiple platforms, including AWS, Salesforce, GA4, BigQuery, and FullStory. You’ll play a key role in shaping the data architecture, enabling data-driven insights across the business.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines in AWS using services such as Lambda, Glue, Step Functions, S3, and Redshift.

• Implement infrastructure as code using AWS CDK.

• Integrate data from various sources, including Salesforce, Google Analytics 4, BigQuery, and FullStory.

• Optimize data flow and ETL processes for performance and reliability.

• Ensure data quality, integrity, and security across all integrations.

• Collaborate with analytics, product, and engineering teams to deliver end-to-end data solutions.

• Monitor, troubleshoot, and continuously improve existing data pipelines and systems.

Key Skills & Experience:

• Proven experience as a Data Engineer with strong AWS expertise.

• Hands-on experience with AWS services (e.g., Glue, Lambda, S3, Redshift, Step Functions).

• Proficient in AWS CDK and infrastructure as code practices.

• Strong SQL skills and experience with data warehousing solutions.

• Experience integrating with platforms like Salesforce, GA4, BigQuery, and FullStory.

• Solid Python or other scripting language skills for ETL and automation tasks.

• Understanding of data governance, security, and best practices in cloud environments.

Bonus Points For:

• Experience with data visualization tools or BI platforms.

• Familiarity with serverless architectures.

• Knowledge of event-driven data pipelines and streaming solutions.