- What Data Engineer Jhb Northern Suburbs Jobs ...
Showing 62 Data Engineer Jhb Northern Suburbs jobs in Johannesburg
Sorry to hear that! What didn’t you like about this job?
Wrong location
Too few details / Lack of information
Job appears outdated
Salary information missing or unclear
Other (please specify).
Please specify...
Verification *
Thank you for your feedback
Your input helps us improve our service.
About the Role Our client, a prominent data analytics firm, is seeking an experienced Lead Data Engineer to manage and enhance their data warehousing infrastructure. This is an on-site role based in our Soweto , Gauteng office, crucial for fostering close collaboration with data scientists, analysts, and business stakeholders. You will be responsible for designing, building, and maintaining robust, scalable data pipelines and data warehouses that support critical business intelligence and reporting functions. We are dedicated to creating a high-performance data environment and promoting a culture of data-driven decision-making. Join us to shape the foundation of our data ecosystem and drive impactful insights.Key Responsibilities
- Lead the design, development, implementation, and maintenance of enterprise data warehouses and data marts.
- Develop and optimize ETL/ELT processes to ingest, transform, and load data from various sources.
- Ensure data quality, integrity, and consistency across all data platforms.
- Collaborate with data scientists and business analysts to understand data requirements and provide solutions.
- Design and implement data models that support efficient querying and reporting.
- Monitor data warehouse performance and implement optimizations.
- Manage and maintain database systems and data integration tools.
- Mentor junior data engineers and provide technical guidance.
- Stay current with data warehousing technologies, best practices, and industry trends.
- Develop and enforce data governance policies and procedures.
Requirements
- Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related quantitative field.
- Minimum of 6 years of experience in data engineering, with a strong focus on data warehousing.
- Proven experience designing and implementing relational and dimensional data models.
- Expertise in SQL and experience with various database technologies (e.g., PostgreSQL, SQL Server, Oracle).
- Proficiency with ETL tools (e.g., Informatica, Talend, SSIS) or scripting languages for data manipulation (e.g., Python).
- Experience with big data technologies (e.g., Spark, Hadoop) is a plus.
- Solid understanding of data warehousing concepts, principles, and best practices.
- Strong analytical, problem-solving, and communication skills.
- Experience leading small teams or mentoring junior engineers is preferred.
Benefits
- Competitive salary and performance-based bonuses.
- Comprehensive health insurance and retirement benefits.
- Opportunities for professional development and training.
- Stable and secure work environment in our Soweto office.
- Be part of a team building the backbone of data analytics.
- Relevant tertiary qualification from a reputable university in:
- Computer Science
- Data Science
- Mathematics
- Statistics
- Engineering
- Information Systems or related field
- Strong experience working with:
- Ability to design, develop, and maintain data pipelines and analytical solutions.
- Experience extracting insights from large and complex datasets.
- Strong problem-solving and analytical skills.
- Excellent communication and stakeholder engagement abilities.
Key Requirements
- Relevant tertiary qualification from a reputable university in:
- Computer Science
- Data Science
- Mathematics
- Statistics
- Engineering
- Information Systems or related field
- Strong experience working with:
- Ability to design, develop, and maintain data pipelines and analytical solutions.
- Experience extracting insights from large and complex datasets.
- Strong problem-solving and analytical skills.
- Excellent communication and stakeholder engagement abilities.
Preferred Experience
- Data modelling and database design.
- Building dashboards and reporting solutions.
- Data warehousing and ETL development.
- Advanced analytics, predictive modelling, or machine learning exposure.
- Experience working within agile and collaborative development environments.
Ideal Candidate
- Strong academic background.
- Stable career history demonstrating commitment and consistent growth.
- Passion for leveraging data to drive business decisions.
- Ability to work independently while collaborating effectively with cross-functional teams.
This role is ideal for someone who sits between Data Engineering and Analytics someone with a solid understanding of data engineering principles, but who is equally comfortable exploring datasets, investigating data quality, performing analysis and translating business questions into meaningful data outputs.
What You’ll Be Doing
- Perform exploratory data analysis (EDA) and validate datasets.
- Use Python extensively for data analysis, investigation and problem-solving.
- Work with real-world and imperfect datasets to identify patterns, issues and insights.
- Support analytics, reporting and insight-driven initiatives .
- Translate client and business questions into clear data outputs and findings.
- Apply data engineering best practices to ensure data is reliable and fit for analytical use.
- Investigate data and communicate findings clearly to both technical and business stakeholders.
- Engage with stakeholders to understand analytical requirements and provide data-driven solutions.
What We’re Looking For
- 2+ years' experience in a Data Engineering, Analytics Engineering or similar data-focused role.
- A solid foundation in data engineering concepts .
- Strong hands‑on experience working with data for analysis and insight generation .
- Strong Python skills, particularly pandas and NumPy .
- Experience performing data exploration, investigation and validation .
- Comfortable working with complex, imperfect or inconsistent datasets.
- Strong problem‑solving abilities and an analytical mindset.
- The ability to interpret data within a business and client context .
- Strong communication skills, with the ability to explain data findings clearly.
Key Responsibilities
- Develop and maintain reliable data pipelines for batch and/or streaming data ingestion.
- Build ETL/ELT processes and transform data for analytics, reporting and downstream applications.
- Design and optimise data models, database queries and data integration workflows.
- Monitor pipeline quality and performance, troubleshoot issues and document data processes.
Job Experience & Skills Required / Ideal Candidate Profile
Education
- A degree, diploma or equivalent relevant qualification in Computer Science, Information Systems, Data Engineering or a related field is advantageous.
- Relevant cloud, database or data engineering certifications will be advantageous.
- Training in analytics platforms or data architecture will be beneficial.
- Demonstrable hands‑on data engineering experience is valued.
Experience
- Typically 4+ years of experience in data engineering, ETL development or a closely related role.
- Strong SQL skills and experience developing data pipelines or ETL/ELT processes.
- Experience with relational databases, data modelling and data quality controls.
- Cloud data platforms, Python, orchestration tools or streaming technologies will be highly advantageous.
Skills
- SQL, data modelling and database performance awareness.
- ETL/ELT, data ingestion, transformation and pipeline orchestration.
- Python or another scripting language.
- Cloud data services, data quality, monitoring and documentation.
Location: Gauteng
About the Role Our client, a reputable financial services firm listed on the Johannesburg Stock Exchange (JSE), holds a strong belief in the transformative power of incremental progress. They are committed to empowering individuals and businesses alike, offering tailored solutions and expert guidance to help pave the way to success. With a focus on innovation and excellence, they provide secure financial futures through personalised advice and cutting‑edge products. Their mission is to support diverse goals and aspirations, enriching lives across every journey.
What you will be doing: Design, maintain, and document data pipelines and products while ensuring data quality and alignment with operational sources. Oversee database performance, security, and access, while monitoring usage, archiving historical data, and identifying design improvements. Develop and uphold coding, naming, change control, and extraction/loading standards. Provide statistical and reporting support to the Business Intelligence team, support data lakehouse operations, and deliver key projects, including data migrations, on time. Partner with IT and business teams to manage relationships, ensure effective service delivery, and support continuous service improvement. Actively manage personal learning, development, and growth while contributing to complex problem‑solving.
What our client is looking for: 3 - 5 years of experience in a similar IT role, with a strong focus on data engineering, warehousing principles, and data lifecyclemanagement (sourcing, cleansing, transformation and analysis). Advanced SQL coding is essential (MS SQL, PostgreSQL). Experience with Databricks, database management (Postgres, SQL Server, MySQL), and building robust ETL processes (SSIS, Glue, Lambda) is required. Experience with cloud software (AWS, Azure) is expected. Knowledge of PowerBI, SAP Data Services, Python/Java, Linux shell scripting, and database administration are considered advantageous. Candidates must demonstrate strong business acumen, analytical problem‑solving abilities, and excellent written and verbal communication skills to facilitate stakeholder engagement. The role requires a candidate who is results‑driven, persistent, flexible, self‑aware, and maintains a collaborative, innovation‑focused, and growth‑oriented mindset.
Key Responsibilities
- Design, develop, and optimize scalable ETL/ELT data pipelines to ingest, transform, and load data from various sources into data warehouses, for example, by Terraforming and DeltaLog data architecture layers using Java, Snowflake, Spack and other tools.
- Advance data pipelines and data management resources such stand‑alone adapters, to be updated using Cloud Infrastructure Automation (CIF) and AWS Cluster Management to support orchestration of data pipelines, metadata flight, new proton process and metadata discovery.
- Perform well‑architected queries, optimization and stream[s] necessary to support secured environments and to defend in non‑secure and OLAP nodes. Carefully create defensive and security context in each node.
- Immerse data streaming or stream handling via deep learning; secure data pipelines making use of system data to produce advanced data and other machine, for example, a new platform.
- Document thoroughly for future references, monitoring the policies.
Requirements
- Minimum 5 years experience as Senior Data Engineer or the direct back‑up experience.
- Critical understanding of data pipelines, architecture evaluation, integration and use case support.
- Knowledge of data modelling through ORM similar to MySQL RDBMS or ER/Md where possible; advanced experiences with AWS or GCP and familiar with their DQ platform.
- Solid experience in deals and templating for back‑end or other terms influence on Data Warehouse changes, which includes maintenance de‑operations processes and testing and analysis of it.
- Deep knowledge analytics and general novel compiler: the front and back for adding new distribution and data layer through the platform, to ensure high availability during any changes.
- Deployment knowledge dominant language XAML or Jython which support mwr test, batch, approach and operations with highly distributed systems. Work with container or data and monitoring component of a system.
- Strong analytical, coordination and communication skills with good experience in a solution design, major projects from building data and pipelines, architecture design, architecture architecture, or framework or design.
- Experience with Cloud environment (Azure, AWS, GCP).
- Hands‑on experience with NoSQL data or Data Lake by object on S3, Minio, or Translate aggregator.
- Solid practices of DevOps fundamentals and Cloud Research/Emphasis, MDS platform to PM PD processes.
- Must be proficient in analyzing how data should be used for different units, power analysis and reduce problems and architecture. Please request for interface response with data lake definition and the Sim.
- Strong debugging of multiplies feedback through both