AWS Data Engineer

The Hiring House; Pretoria; On-site; ZAR 600,000 - 900,000; Full time

Job summary

A leading company in data solutions seeks a seasoned Data Engineer to enhance their data architecture and pipeline processes. The role requires expertise in AWS services along with a solid background in data management and transformation. Candidates should hold a Bachelor's degree in Computer Science or Engineering, with at least 5 years of applicable experience. Join a dynamic team focused on security, compliance, and mentorship.

Qualifications

• 5+ years working experience in Data Engineering.
• AWS Certified Data Engineer, Solutions Architect, or Data Analyst preferred.
• Experience with SQL and NoSQL databases (PostgreSQL, MySQL, DynamoDB) is essential.

Responsibilities

• Develop and manage data architecture, ensuring data quality and compliance.
• Create and optimize data pipelines and ETL processes.
• Mentor development teams and collaborate on projects involving AWS cloud infrastructure.

Skills

Data Architecture and Management

Pipeline Development and ETL

Automation, Monitoring and Optimization

Security, Compliance and Best Practices

SQL

NoSQL

AWS Services

Development Team Mentorship

Education

Bachelors degree in Computer Science or Engineering

Honors degree in Computer Science or Engineering

Job description

Key Performance Areas

• Data Architecture and Management
• Pipeline Development and ETL
• Automation, Monitoring and Optimization
• Security, Compliance and Best Practices
• Development Team Mentorship and Collaboration
• QMS and Compliance

Minimum education (essential) :

Bachelors degree in Computer Science or Engineering (or similar)

Minimum education (desirable) :

Honors degree in Computer Science or Engineering (or similar)

AWS Certified Data Engineer or

AWS Certified Solutions Architect or

AWS Certified Data Analyst

Minimum applicable experience (years) :

5+ years working experience

Required nature of experience :

Data Engineering development

Experience with AWS services used for data warehousing, computing and transformations ie. AWS Glue (crawlers, jobs, triggers, and catalog), AWS S3, AWS Lambda, AWS Step Functions, AWS Athena and AWS CloudWatch

Experience with SQL and NoSQL databases (e.g., PostgreSQL, MySQL, DynamoDB)

Experience with SQL for querying and transformation of data