Senior Data Engineer

Equal Experts; Cape Town; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading consulting firm in Cape Town is seeking a contract Data Engineer to develop data pipelines and storage solutions. The ideal candidate has senior-level experience, proficiency in Cloud platforms like AWS or GCP, and strong skills in Python or Scala. You'll work in an agile environment, mentoring clients and improving data capabilities. Join a community of experts and enjoy flexible working conditions with great leave benefits.

Benefits

Knowledge-sharing culture

Community support from experts

Great leave benefits

Qualifications

• Significant experience working on data pipelines and platforms.
• Experience in developing solutions in major Cloud providers.
• Strong background in at least one programming language.

Responsibilities

• Determine data processing needs with clients.
• Creation of highly available data pipelines.
• Delivery of software using agile practices.
• Automation of data infrastructure.

Skills

Data pipelines

AWS

GCP

Python

Scala

SQL

Data modeling

Collaboration skills

Tools

Git

GitHub

Terraform

Ansible

Job description

Equal Experts is an innovative consultancy specialising in the delivery of custom software solutions for blue-chip enterprise and public-sector clients across a range of industry sectors.

We work on important projects for our clients, deliver market-leading propositions across the digital, online and mobile channels, and are recognised for our leadership in the application of agile and lean delivery methods to assure delivery.

We're looking for contract Data Engineers with proven senior-level experience to join the Equal Experts network.

Our Data Engineers are highly skilled in creating data pipelines for ingest, transformation and storage of data, usually at scale, and are familiar with standing-up analytics clusters.

This role involves using modern agile technical practices – including Continuous Integration and Deployment, TDD, and XP – to deliver timely and pragmatic solutions, as well as helping others to do their jobs in a more effective way.

Responsibilities

Working with the client and the team to determine data processing and access needs and how best to deliver them.

Creation and support of highly available data pipelines and storage solutions (e.g. data warehouses).

Delivery of software using agile (pair programming, TDD, CI / CD, etc.) practices.

Automation of data infrastructure and deployments.

Advocating agile practices to the client organisation.

Mentoring client team members.

Helping improve the team and clients' data capabilities.

Required Skills

Significant experience working on data pipelines, platforms and projects.

Experience in developing solutions in one or more of the main Cloud providers (AWS, GCP).

Strong background in at least one programming language, Python or Scala preferable.

Working with a variety of databases, data warehouses and distributed file systems in production.

Strong experience in SQL and data modelling.

Exposure with data processing at scale.

Knowledge about GDPR and data security

Working with source control and infrastructure as code (Git / Github, Terraform, Ansible etc.) and CI / CD tools.

Understanding and being able to support data scientists or business intelligence teams – in data prep, mentoring and support functions.

Strong collaboration and communication skills, including the ability to communicate effectively while working remotely with globally distributed teams.

Experience tells us that there are no barriers to who has talent and ability.

So whatever your gender, race, sexuality, level of physical ability or stage of life; if you have the skills we're looking for we'd love to hear from you.

What the global Equal Experts network offers you

We're more than a consultancy.

We're a community.Our knowledge-sharing, problem-solving culture means you'll always have support from other experts in your field.

Even if you're between contracts.

All our people are highly experienced.Our consultants typically have at least 10 years' experience of solving difficult business problems – and often much more.

We invest in a grown-up culture.You'll have the freedom and focus to stay hands-on, and the autonomy to do your work well.

Great leave benefits.

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

IT Services and IT Consulting

Apply now using the 'Easy Apply' button above