Senior Databricks Data Engineer

Hileya - Management Consulting

Sandton

On-site

ZAR 500,000 - 700,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Hileya - Management Consulting is looking for strong Data Engineers to join their Data, Information and Analytics team. This is a client-facing position requiring at least 3 years of experience in data engineering and strong SQL knowledge.

Responsibilities include engaging with clients for data solutions, modernizing data environments, and building optimal data pipeline architectures. Candidates should be passionate about data and experienced in optimizing data processes across various platforms.

Qualifications

Minimum 3 years working experience in data engineering.
Experience building and optimizing data pipelines, architectures, and data structures.
Strong project management and organizational skills.

Responsibilities

Engage with clients to conceptualize data solutions.
Modernize existing data environments.
Create and maintain optimal data pipeline architecture.

Skills

Strong analytic skills

Advanced SQL knowledge

Experience with data pipelines

Project management skills

Education

Microsoft Certified Solutions Associate: Data & Analytics

Tools

Microsoft Azure

AWS

GCP

Power BI

SQL Server

Job description

Work Location:

Cape Town CBD – onsite for 3 days per week

Job Description / Responsibilities:

Looking for strong Data Engineers to join our Data, Information and Analytics team as client-facing, permanently employed consultants. Someone who is passionate about data and implementing technology solutions and leading project teams to achieve business outcomes. There will be exposure to a wide range of industries, so the ability to quickly understand new business environments is essential.

Responsibilities include:

Engage with clients to conceptualize data solutions
Modernize existing data environments
Assist our sales team with Pre‑Sales and POC’s
Create and maintain optimal data pipeline architecture; assemble large, complex data sets that meet functional and non‑functional business requirements
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re‑designing infrastructure for greater scalability
Build the infrastructure required for optimal extraction, transformation and loading of data from a wide variety of data sources using Microsoft, Azure, AWS, GCP, technologies etc.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data‑related technical issues and support their data infrastructure needs
Work with data and analytics experts to strive for greater functionality in our data systems
Assist support desk where applicable

Background and experience required:

Minimum 3 years working experience in data engineering
Advanced working SQL knowledge and experience with relational databases, query authoring (SQL) as well as familiarity with a variety of databases
Experience building and optimizing data pipelines, architectures, and data structures
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement
Strong analytic skills related to working with unstructured datasets
Build processes supporting data transformation, data structures, metadata, dependency and workload management
A successful history of manipulating, processing and extracting value from large, disconnected datasets
Strong project management and organizational skills
Experience supporting and working with cross‑functional teams in a dynamic environment

Microsoft Qualifications