Data Engineer

Decision Inc.; Johannesburg; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Health benefits

Professional growth

Collaborative culture

Cutting-edge technologies

Job summary

Decision Inc in Johannesburg is seeking a highly skilled Data Engineer with Databricks expertise to design, build, and maintain data pipelines and platforms supporting client data needs.

You will collaborate with data scientists, analysts, and business stakeholders to ensure data accuracy, performance, and scalability, while continuously improving data infrastructure and mentoring junior engineers.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum of 3 years of data engineering experience with a focus on Databricks.
• Strong experience with SQL, Python, and ETL processes.

Responsibilities

• Design, build, and maintain data pipelines and platforms using Databricks.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions.
• Develop and implement data quality and monitoring processes to ensure accuracy and reliability of data.
• Optimize data pipelines for performance and scalability.
• Troubleshoot and resolve data pipeline issues in a timely manner.
• Stay up-to-date with data engineering trends and technologies and recommend improvements.
• Mentor and provide guidance to junior data engineers.

Skills

SQL

Python

ETL pipelines

Data modeling

Problem solving

Communication

Education

Bachelor's degree (CS/Engineering)

Tools

Databricks

Cloud platforms (AWS/Azure/GCP)

Job description

Company Overview:

Decision Inc is a leading technology and consulting company that helps businesses make better decisions through data-driven solutions. With a team of experienced professionals and a strong focus on innovation, Decision Inc has become a trusted partner for companies looking to unlock the full potential of their data.

Who Are We?

Decision Inc. is a global digital partner that enables businesses to reinvent themselves to realise their full potential.

We deliver agility, resilience, and intelligence to any enterprise, enabling them to adapt quickly and thrive through innovation and opportunity. Our teams have engaged with more than 400 clients globally over the past 15 years, providing them with the expertise to build, operate, and optimise their digital businesses.

We achieve this by leveraging the world's best technology to drive our client's business ambitions forward into tomorrow's reality. These technologies include but are not limited to: Microsoft, SAP, Qlik, Snowflake, Alteryx, Automation Anywhere, and Workday Adaptive Insights.

Our success is ultimately driven by our entrepreneurial culture, industry exposure, and the passion of our people. We have three key cross-functional teams – Functional and Specialist Consulting, Development, and Engineering teams. Based in four global offices, our exceptional consultants focus on delivering value to clients by keeping them at the centre of our service delivery. To find out more about our exciting fast-paced culture visit: Careers at Decision Inc.

Job Overview:

We are seeking a highly skilled Data Engineer with experience in Databricks to join our team in Johannesburg. In this role, you will be responsible for designing, building, and maintaining data pipelines and platforms to support our clients' data needs. You will work closely with our data scientists, analysts, and business stakeholders to ensure the accuracy, efficiency, and scalability of our data infrastructure.

Key Responsibilities:

• Design, build, and maintain data pipelines and platforms using Databricks
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions that meet their needs
• Develop and implement data quality and monitoring processes to ensure the accuracy and reliability of data
• Optimize data pipelines for performance and scalability
• Troubleshoot and resolve data pipeline issues in a timely manner
• Stay up-to-date with the latest data engineering trends and technologies and make recommendations for improvements to our data infrastructure
• Mentor and provide technical guidance to junior data engineers

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field
• Minimum of 3 years of experience in data engineering, with a focus on Databricks
• Strong experience with SQL, Python, and ETL processes
• Experience with cloud-based data platforms such as AWS, Azure, or Google Cloud
• Knowledge of data modeling and database design principles
• Familiarity with data warehousing concepts and tools
• Excellent problem-solving and analytical skills
• Strong communication and collaboration skills

Benefits:

• Competitive salary package
• Comprehensive health and wellness benefits
• Opportunities for professional growth and development
• Dynamic and collaborative work environment
• Chance to work with cutting-edge technologies and innovative solutions

If you are a highly motivated and experienced Data Engineer with a passion for Databricks and want to be a part of a dynamic and growing company, we encourage you to apply for this exciting opportunity. Join us at Decision Inc and help us empower businesses to make better decisions through data.