Data Engineer

Bsg; Johannesburg; On-site; ZAR 600,000 - 800,000; Full time

Job summary

BSG is seeking Data Engineers to join their team in Johannesburg. The successful candidates will design and build data platforms using SQL, Python, Java, and cloud technologies like AWS and Azure, contributing to business insights and decision-making. Ideal candidates will have a minimum of an Honours or Masters’ degree and 4 years of experience in software development, along with proficiency in data engineering practices.

Qualifications

• 4 years’ experience in enterprise software development.
• Proficiency in SQL and either Python, Java, or .NET.
• Awareness of Data Engineering paradigms.

Responsibilities

• Architect, design and build data platforms and products.
• Collaborate with Data Scientists to build data pipelines.
• Deploy models into production on cloud platforms.

Skills

SQL

Python

Java

.NET

Data Engineering Paradigms

Big Data Tools

Cloud Data Services

Education

Honours or Masters’ Degree in Computer Science

Information Systems or related field

Job description

We are looking for Data Engineers who can join our team to architect and build data platforms to power insight-led business solutions. We are currently working on AWS and Microsoft Azure cloud platforms, using SQL, Python, Java, .NET and other technologies.

Are you inspired to engineer enterprise-grade, scalable data platforms that solve challenging business problems? Are you inspired to transform the way people and businesses work, and the experience they deliver to their customers? Do you want to continuously learn and grow, by working with the most talented people in South Africa? Then you will love it here!

Note: We give full consideration to every applicant’s fit to this role, so if you decide to apply and you do not hear from BSG within a maximum of a four-week period, please consider your application unsuccessful at this time.

Main Purpose of the Role:

Data Engineers work in multi-skilled teams to architect, design and build data platforms and data products. These provide insights for better decision-making and smarter business processes.

Minimum Qualifications:

• Honours or Masters’ Degree in Computer Science, Information Systems, Engineering, Physics, Mathematics, Statistics or related field
• 4 years’ experience in enterprise software development, including proficiency in SQL and Python / Java / .NET
• Awareness of Data Engineering paradigms such as data warehousing, data mesh or data vault

Experience:

• 4-8 years’ experience working in teams to build enterprise-grade software solutions
• Experience with big data tools, such as found in the Hadoop ecosystem, is advantageous
• Experience with AWS or MS Azure cloud data services is preferable

Job Objectives:

• Be an ambassador for BSG’s insight-led business solutions
• Attract talent to BSG’s Data and Analytics capability, and coach emerging Data Engineers
• Support relationship sales through expertise, analysis of our clients’ problems / opportunities and use cases, and high-level design of solution options
• Work with others to define the business problem and identify which data-driven insights and data sources will help to solve that problem
• Work with Data Scientists to identify relevant data from internal / external sources, join / transform the data and explore it for insight
• Work together with Data Scientists to build data pipelines and architect, train, validate and test advanced analytics / machine learning models, using enterprise-grade software engineering practices
• Communicate to business and technical stakeholders how and why the insights and / or models work
• Deploy models into production, on cloud (or sometimes on-premise) AI / ML / data platforms

Skills and Attributes:

• Relate to people and build productive working relationships
• Understand client business problems and identify data-driven solutions
• A clear understanding of the data engineering and data science lifecycle and its constituent parts: data exploration, data preparation, data wrangling and feature engineering, tools, analytical methods, model evaluation, deployment, and performance monitoring
• Estimate the effort, skills and dependencies to deliver data-driven solutions
• Select appropriate technologies and tools, and learn new ones
• Architect and build data pipelines, including data aggregation and transformation
• Deploy pipelines in production
• Communicate clearly to to business and technical stakeholders