Databricks Data Engineer: Build Scalable Pipelines

Decision Inc.; Johannesburg; On-site; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Competitive salary

Health benefits

Professional growth

Collaborative culture

Cutting-edge technologies

Job summary

Decision Inc in Johannesburg is seeking a highly skilled Data Engineer with Databricks expertise to design, build, and maintain data pipelines and platforms supporting client data needs.

You will collaborate with data scientists, analysts, and business stakeholders to ensure data accuracy, performance, and scalability, while continuously improving data infrastructure and mentoring junior engineers.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum of 3 years of data engineering experience with a focus on Databricks.
• Strong experience with SQL, Python, and ETL processes.

Responsibilities

• Design, build, and maintain data pipelines and platforms using Databricks.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and develop solutions.
• Develop and implement data quality and monitoring processes to ensure accuracy and reliability of data.
• Optimize data pipelines for performance and scalability.
• Troubleshoot and resolve data pipeline issues in a timely manner.
• Stay up-to-date with data engineering trends and technologies and recommend improvements.
• Mentor and provide guidance to junior data engineers.

Skills

SQL

Python

ETL pipelines

Data modeling

Problem solving

Communication

Education

Bachelor's degree (CS/Engineering)

Tools

Databricks

Cloud platforms (AWS/Azure/GCP)

Job description

Decision Inc in Johannesburg is seeking a highly skilled Data Engineer with Databricks expertise to design, build, and maintain data pipelines and platforms supporting client data needs.

You will collaborate with data scientists, analysts, and business stakeholders to ensure data accuracy, performance, and scalability, while continuously improving data infrastructure and mentoring junior engineers.