AWS Data Engineer Market related

Cruze Control Technologies; Midrand; On-site; ZAR 600,000 - 900,000; Full time

Job summary

Cruze Control Technologies is seeking an AWS Data Engineer to design, implement, and maintain scalable data pipelines using AWS services. You will ensure data sharing aligns with information classification requirements and work closely with teams to validate data quality.

You will deploy and optimize pipelines with AWS Glue, Data Pipeline, and related tools while leveraging Python, PySpark, and Boto3. Prior automotive industry experience is a plus.

Qualifications

• Degree required.
• Certifications such as AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate/Professional, Hashicorp Terraform Associate.

Responsibilities

• Build and maintain Big Data Pipelines.
• Ensure data sharing aligns with information classification needs.
• Test and validate data transformations for accuracy.
• Document findings with clear, precise notes.

Skills

Analytical skills

Communication skills

Self-driven

Organizational skills

REST APIs

Teamwork

Python

PySpark

Boto3

Education

Degree

AWS Certifications (Cloud Practitioner)

HashiCorp Terraform认证

Tools

Terraform

Docker

AWS Glue

Data Pipeline

Job description

AWS Data Engineer

The AWS Data Engineer will be responsible for building and maintaining Big Data Pipelines using Data Platforms and must ensure that data is shared in line with the information classification requirements on a need-to-know basis.

Duties & Responsibilities

• Exceptional analytical skills analyzing large and complex data sets.
• Perform thorough testing and data validation to ensure the accuracy of data transformations.
• Strong written and verbal communication skills, with precise documentation.
• Self-driven team player with ability to work independently and multi-task.
• Experience building data pipeline using AWS Glue or Data Pipeline, or similar platforms.
• Familiar with data stores such as AWS S3, and AWS RDS or DynamoDB.
• Experience and solid understanding of various software design patterns.
• Experience preparing specifications from which programs will be written, designed, coded, tested, and debugged.
• Strong organizational skills. Experience developing and working with REST APIs is a bonus.
• Basic experience in Networking and troubleshooting network issues.

Desired Experience & Qualification

• Degree
• Certifications such as AWS Certified Cloud Practitioner, AWS Certified SysOps Associate, AWS Certified Developer Associate, AWS Certified Architect Associate, AWS Certified Architect Professional, Hashicorp Certified Terraform Associate
• Automotive industry experience
• Terraform
• Python 3.x
• Py Spark
• Boto3
• ETL
• Docker
• Powershell / Bash
• Must have 3 – 5 years working experience
• 3 – 5 years experience in working with Enterprise Collaboration tools such as Confluence, JIRA
• 3 – 5 years experience developing technical documentation and artifacts.
• Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV
• Experience working with Data Quality Tools such as Great Expectations
• Knowledge of the Agile Working Model

Market related