Databricks Data Engineer

iO Associates; Cape Town; On-site; ZAR 300 000 - 400 000; Full time

Job summary

A leading technology company in Cape Town is seeking a talented Databricks Data Engineer for a contract role. You will develop and maintain data architectures and pipelines to drive strategic objectives. Essential qualifications include proven experience with Databricks, strong SQL skills, and knowledge of cloud technologies like AWS or Azure. This role offers up to £180 per day, in a collaborative and innovative environment.

Qualifications

• Proven experience as a Data Engineer working with Databricks.
• Strong proficiency in SQL and data modeling.
• Knowledge of ETL processes and data pipeline development.
• Familiarity with cloud technologies such as AWS or Azure.

Responsibilities

• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Implement data pipelines and workflows using Databricks to support business requirements.
• Collaborate with cross-functional teams to gather and understand data requirements.
• Troubleshoot data-related issues and optimize performance for maximum efficiency.

Skills

Proven experience as a Data Engineer working with Databricks

Strong proficiency in SQL and data modeling

Knowledge of ETL processes and data pipeline development

Familiarity with cloud technologies such as AWS or Azure

Tools

Databricks

Hadoop

Spark

Job description

Databricks Data Engineer
Cape Town, South Africa
3-6 months contract initially
Day rate up to £180/day (~ZAR 4,100/day)

Our Client Overview:

Our client is a leading technology company at the forefront of innovation in data engineering and analytics. They are committed to creating a dynamic and inclusive work environment that fosters creativity and collaboration. With a strong emphasis on growth and continuous learning, our client offers exciting opportunities for professionals to thrive in their careers.

Role Summary:

Our Client is seeking a talented and experienced Databricks Data Engineer to join their team on a contract basis. This role is pivotal in driving data-related initiatives and supporting the company's strategic objectives. As a Databricks Data Engineer, you will play a crucial role in designing and implementing data solutions that will have a direct impact on the organization's success.

Responsibilities:

• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Implement data pipelines and workflows using Databricks to support business requirements.
• Collaborate with cross-functional teams to gather and understand data requirements.
• Troubleshoot data-related issues and optimize performance for maximum efficiency.

Essential Skills & Experience:

• Proven experience as a Data Engineer working with Databricks.
• Strong proficiency in SQL and data modeling.
• Knowledge of ETL processes and data pipeline development.
• Familiarity with cloud technologies such as AWS or Azure.

Desirable Skills & Experience:

• Certification in Databricks.
• Experience with big data tools like Hadoop or Spark.
• Background in software development.
• Excellent problem-solving skills and attention to detail.

Call to Action:

If you are a skilled Databricks Data Engineer looking to make a significant impact in a dynamic tech company, we invite you to apply by submitting your CV today. Join Our Client's team and be part of shaping the future of data engineering.