Data Engineer

OUTsurance; Centurion; On-site; ZAR 600,000 - 1,000,000; Full time

Job summary

OUTsurance in Centurion, Gauteng, seeks a data engineer to design and optimize data pipelines, data warehouses, and data products. You will work with software development, actuarial, payroll and finance teams to deliver quality datasets at speed.

The role requires 3+ years in data engineering, strong Python and SQL, experience with Databricks and cloud platforms; you will implement data quality checks and collaborate to drive scalable data infrastructure.

Qualifications

• Bachelor's degree or equivalent in CS/Engineering or related field.
• 3+ years of data engineering or related experience.
• Proficiency in Python and SQL.
• Experience with data modelling, ETL, and warehousing.
• Cloud experience (AWS/GCP/Azure) and data technologies like Databricks, DeltaLake, AirFlow.

Responsibilities

• Design, build and maintain scalable data pipelines for large data volumes.
• Develop and maintain data models, databases and data warehouses for analytics teams.
• Ensure data quality via validation and monitoring processes.
• Collaborate with data scientists, analysts and stakeholders to meet data needs.
• Communicate complex problems clearly and effectively.

Skills

Python

SQL

Data modelling

ETL

Communication

Education

Bachelor's degree in Computer Science/Engineering

Tools

Databricks

Azure/AWS/GCP

SQL Server

AirFlow

Power BI

Job description

OUTsurance has been propelling the South African insurance industry forward for the last 28 years. As leaders in the field, we’re always looking for innovative ways to create digitally-advanced solutions, without losing sight of our human values. Our continued success can be attributed to outstanding employees who set the bar high with their energy and expertise. If you’re keen to grow your career in a vibrant environment with lots of ‘fun’, this could be the career opportunity you’ve been looking for.

Job Description

Do you live and breathe all things data related?

We are looking for a data engineer to join our growing team. Are you passionate about the technical aspects of OUTs data landscape? See it as a challenge to build processes that are optimised to run as quick as possible, delivering quality data sets that can be reused by multiple teams. As a data engineer within our team, you will be responsible for developing best practices and patterns, maintain our current workloads, optimize our data warehouse builds, data pipelines, and data products. The data engineer will support multiple stakeholders, including software development, actuarial, payroll and finance analytical teams.

Your Duties and responsibilities:

• Design, build and maintain scalable and reliable data pipelines to process large volumes of data from various sources.
• Develop and maintain data models, databases, and data warehouses to support the analytic teams reporting needs.
• Ensure data quality and accuracy by implementing data validation and monitoring processes.
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs and provide solutions to support their work.
• Excellent written and verbal communication skills; with the ability to explain complex problems in a simple and effective manner.

Team Responsibilities:

• To design and build highly available, scalable, and fault-tolerant data infrastructure to support data processing.
• Develop and maintain infrastructure automation tools, deployment pipelines, and monitoring systems.
• Core to this is the team’s collaboration with other engineers, data scientists, and analysts to ensure the availability and performance of the data infrastructure.
• We evaluate new data technologies and tools that enhances the performance and reliability of the data infrastructure and drive adoption of these technologies within the bigger data community.

Create best practise “formulas” that aligns with OUTs data strategy and assist the analytical teams in adopting them.

• Ability to apply industry best practices
• Ability to give input into innovative solutions
• Ability to work under pressure and tight deadlines
• Self-motivated and a self-starter
• Ability to work in a team environment

Technologies used on-prem

• SQL Server
• SSRS
• SSAS
• Power BI

Technologies used in cloud

• Databricks

Qualifications

• Bachelor\'s degree in Computer Science, Engineering, or a related field.
• 3+ years of experience in data engineering or related fields.
• Proficiency in at least one programming language (Python, C#, etc.) and SQL.
• Proven experience with data modelling, ETL processes, and data warehousing.
• Experience with cloud platforms such as AWS, GCP, or Azure
• Understanding of data processing technologies and data management principles
• Familiarity with data technologies such as Synapse, Databricks, DeltaLake, and AirFlow

Additional Information

An ideal candidate will be able to align their personal work values to the OUTsurance values of Awesome Service, Dynamic, Honest, Human, Passionate and Recognition.

At OUTsurance our value of HUMAN is more than just a poster on the wall. It’s a key part of our culture, we are committed to fostering an inclusive and diverse workplace that reflects the communities we serve. We actively encourage applications from persons with disabilities. In support of our Employment Equity objectives, we strive to create equal opportunities for all and welcome candidates from designated groups who meet the role requirements.

By clicking the link above or any third-party link within this posting, you are leaving this site and going to a third-party website where the third-party website\'s terms and privacy policy apply