Data Engineer

BSG; Johannesburg; On-site; ZAR 600 000 - 900 000; Full time

Job summary

A technology consulting firm is looking for Data Engineers in Johannesburg to architect and build data platforms using SQL, Python, Java, and .NET. The role involves creating enterprise-grade software solutions, collaborating with Data Scientists, and deploying models into production on cloud platforms like AWS and Azure. Candidates must hold an Honours or Masters' Degree in a relevant field with 4 years' software development experience. This is an opportunity to work with talented professionals and grow your career in South Africa.

Qualifications

• 4 years’ experience in enterprise software development, including proficiency in SQL and Python / Java / .NET.
• Awareness of Data Engineering paradigms such as data warehousing or data vault is essential.
• 4-8 years’ experience working in teams to build enterprise-grade software solutions.

Responsibilities

• Architect, design and build data platforms and data products to provide insights.
• Support relationship sales through analysis of clients’ problems and high-level design of solution options.
• Deploy models into production, on cloud or on-premise data platforms.

Skills

SQL

Python

Java

.NET

Data Engineering paradigms

Education

Honours or Masters’ Degree in Computer Science or related field

Tools

AWS

Microsoft Azure

Hadoop ecosystem

Job description

We are looking for Data Engineers who can join our team to architect and build data platforms to power insight-led business solutions. We are currently working on AWS and Microsoft Azure cloud platforms, using SQL, Python, Java, .NET and other technologies.

Are you inspired to engineer enterprise-grade, scalable data platforms that solve challenging business problems? Are you inspired to transform the way people and businesses work, and the experience they deliver to their customers? Do you want to continuously learn and grow, by working with the most talented people in South Africa? Then you will love it here!

Note: We give full consideration to every applicant’s fit to this role, so if you decide to apply and you do not hear from BSG within a maximum of a four-week period, please consider your application unsuccessful at this time.

Main Purpose of the Role:

Data Engineers work in multi-skilled teams to architect, design and build data platforms and data products. These provide insights for better decision-making and smarter business processes.

Minimum Qualifications:

• Honours or Masters’ Degree in Computer Science, Information Systems, Engineering, Physics, Mathematics, Statistics or related field
• 4 years’ experience in enterprise software development, including proficiency in SQL and Python / Java / .NET
• Awareness of Data Engineering paradigms such as data warehousing, data mesh or data vault

Experience:

• 4-8 years’ experience working in teams to build enterprise-grade software solutions
• Experience with big data tools, such as found in the Hadoop ecosystem, is advantageous
• Experience with AWS or MS Azure cloud data services is preferable

Job Objectives:

• Be an ambassador for BSG’s insight-led business solutions
• Attract talent to BSG’s Data and Analytics capability, and coach emerging Data Engineers
• Support relationship sales through expertise, analysis of our clients’ problems / opportunities and use cases, and high-level design of solution options
• Work with others to define the business problem and identify which data-driven insights and data sources will help to solve that problem
• Work with Data Scientists to identify relevant data from internal / external sources, join / transform the data and explore it for insight
• Work together with Data Scientists to build data pipelines and architect, train, validate and test advanced analytics / machine learning models, using enterprise-grade software engineering practices
• Communicate to business and technical stakeholders how and why the insights and / or models work
• Deploy models into production, on cloud (or sometimes on-premise) AI / ML / data platforms

Skills and Attributes:

• Relate to people and build productive working relationships
• Understand client business problems and identify data-driven solutions
• A clear understanding of the data engineering and data science lifecycle and its constituent parts: data exploration, data preparation, data wrangling and feature engineering, tools, analytical methods, model evaluation, deployment, and performance monitoring
• Estimate the effort, skills and dependencies to deliver data-driven solutions
• Select appropriate technologies and tools, and learn new ones
• Architect and build data pipelines, including data aggregation and transformation
• Deploy pipelines in production
• Communicate clearly to to business and technical stakeholders