Senior Data Engineer

NTT Limited; Johannesburg; Hybrid; ZAR 700,000 - 900,000; Full time

Job summary

A leading technology company in Johannesburg is seeking a Senior Data Engineer responsible for designing and maintaining scalable data pipelines. This role involves collaborating with various stakeholders, optimizing large-scale data processing, and ensuring compliance with data governance. The ideal candidate should possess a Bachelor's degree and relevant certifications. This position offers a hybrid working model.

Qualifications

• Proficient in building modern data analytics solutions from large data sets.
• Advanced experience in designing secure and scalable systems.
• Experience in automation and scripting.

Responsibilities

• Design and implement data pipelines (ETL/ELT).
• Build and maintain data warehouses and lakes.
• Collaborate with data scientists to understand data needs.

Skills

Data engineering

ETL/ELT processes

SQL

Data quality assurance

Data pipeline automation

Education

Bachelor's degree in computer science or related field

Relevant certifications in SAP, Microsoft Azure, Snowflake

Tools

Microsoft Azure Data Factory

Snowflake

Databricks

Job description

Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

The Senior Data Engineer is responsible for designing, building, and maintaining scalable data pipelines.

Key Responsibilities:

• Design and implement robust, scalable, and secure data pipelines (ETL/ELT).
• Build and maintain data warehouses, data lakes, and real-time streaming systems.
• Develop and optimize workflows for large-scale data processing.
• Manage and maintain dataenvironments, including performance tuning and cost optimization.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
• Ensure data quality, integrity, and compliance with data governance and privacy regulations (e.g., POPIA, GDPR).
• Mentor junior engineers and contribute to best practices and code reviews.
• Automate data validation, monitoring, and alerting processes.
• Integrate data from various sources including APIs, databases, and third-party platforms.
• Directs test scenarios and is responsible for participating in thorough testing and validation to support the accuracy of data transformations.
• Works across multiple IT and business teams to define and implement data table structures and data models based on requirements.
• Works with various stakeholders to evaluate potential data requirements.
• Networks with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models.

Knowledge and Attributes:

• Advanced knowledge of the definition and management of scoping requirements, definition and prioritization activities.
• Advanced understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models.
• Advanced expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP. Snowflake and Databricks
• Advanced understanding of data architecture landscape between physical and logical data models
• Analytical mindset with excellent business acumen skills.
• Problem-solving aptitude with the ability to communicate effectively, both written and verbal.
• Ability to think strategically and build effective relationships at all levels within the organization.

Academic Qualifications and Certifications:

• Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
• Relevant certifications preferred such as SAP, Microsoft Azure, Snowflake and Databricks.
• Certified Data Engineer, Certified Professional certification preferred.

Required experience:

• Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale.
• Advanced demonstrated experience with architecture and design of secure, highly available and scalable systems.
• Advanced proficiency in automation, scripting and proven examples of successful implementation.

Workplace type :

Hybrid Working

Make an impact with NTT DATA
Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.

The Senior Data Engineer is responsible for designing, building, and maintaining scalable data pipelines. Key Responsibilities:

• Design and implement robust, scalable, and secure data pipelines (ETL/ELT).
• Build and maintain data warehouses, data lakes, and real-time streaming systems.
• Develop and optimize workflows for large-scale data processing.
• Manage and maintain dataenvironments, including performance tuning and cost optimization.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
• Ensure data quality, integrity, and compliance with data governance and privacy regulations (e.g., POPIA, GDPR).
• Mentor junior engineers and contribute to best practices and code reviews.
• Automate data validation, monitoring, and alerting processes.
• Integrate data from various sources including APIs, databases, and third-party platforms.
• Directs test scenarios and is responsible for participating in thorough testing and validation to support the accuracy of data transformations.
• Works across multiple IT and business teams to define and implement data table structures and data models based on requirements.
• Works with various stakeholders to evaluate potential data requirements.
• Networks with various stakeholders, contributing to the recommendation of improvements in automated and non-automated components of the data tables, data queries and data models.

Knowledge and Attributes:

• Advanced knowledge of the definition and management of scoping requirements, definition and prioritization activities.
• Advanced understanding of database concepts, object and data modelling techniques and design principles and conceptual knowledge of building and maintaining physical and logical data models.
• Advanced expertise in Microsoft Azure Data Factory, SQL Analysis Server, SAP Data Services, SAP BTP. Snowflake and Databricks
• Advanced understanding of data architecture landscape between physical and logical data models
• Analytical mindset with excellent business acumen skills.
• Problem-solving aptitude with the ability to communicate effectively, both written and verbal.
• Ability to think strategically and build effective relationships at all levels within the organization.

Academic Qualifications and Certifications:

• Bachelor's degree or equivalent in computer science, software engineering, information technology, or a related field.
• Relevant certifications preferred such as SAP, Microsoft Azure, Snowflake and Databricks.
• Certified Data Engineer, Certified Professional certification preferred.

Required experience:

• Proficient in building modern data analytics solutions that delivers insights from large and complex data sets with multi-terabyte scale.
• Advanced demonstrated experience with architecture and design of secure, highly available and scalable systems.
• Advanced proficiency in automation, scripting and proven examples of successful implementation.

Workplace type :

Hybrid Working

About NTT DATA
NTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure, and connectivity. We are also one of the leading providers of digital and AI infrastructure in the world. NTT DATA is part of NTT Group and headquartered in Tokyo.

Equal Opportunity Employer
NTT DATA is proud to be an Equal Opportunity Employer with a global culture that embraces diversity. We are committed to providing an environment free of unfair discrimination and harassment. We do not discriminate based on age, race, colour, gender, sexual orientation, religion, nationality, disability, pregnancy, marital status, veteran status, or any other protected category. Join our growing global team and accelerate your career with us. Apply today.

About Us

Is innovation part of your DNA? Do you want to enable a connected future for people, organizations, and society?

Join our growing global NTT family and you’ll be part of the world’s largest ICT company (by revenue). We’ve combined the capabilities of 28 remarkable companies to become one, leading technology services provider. Together, we help our people, clients, and communities do great things with technology to create a more secure and connected future.

We employ 40,000 people across 57 countries. By bringing together the world’s best technology companies and emerging innovators, we work together to deliver sustainable outcomes to businesses and the world. Innovation is part of our DNA. We believe it’s key to what makes us different. So, we strive to move forward, challenge the status quo, and drive excellence through the technologies we integrate and the services we deliver around the world. The result is connected cities, connected factories, connected healthcare, connected agriculture, connected conservation, connected mobility, and connected sport. Together we enable the connected future.

You’ll be joining a global employer that is committed to attracting, growing and keeping the best talent. A place where you will be at the heart of our success!