Data Engineer

-; Kareeberg Local Municipality; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading company in the energy sector is seeking a Data Engineer to develop and deliver cloud-based data engineering solutions. The role involves designing data architectures, supporting digital projects, and ensuring compliance with company standards. Ideal candidates will have a numerate honors degree and extensive experience with cloud platforms like AWS and Microsoft Azure. Strong communication skills and the ability to multitask under tight deadlines are essential.

Qualifications

• Extensive experience with relational databases and cloud platforms.
• Ability to develop technical solutions based on business needs.
• Proficiency in English.

Responsibilities

• Design, develop, and implement end-to-end data solutions in AWS.
• Support incident resolution for productionized digital solutions.
• Act as liaison between business users and IT for cloud solutions.

Skills

Data Ingestion

Data Integration

Data Storage

Data Processing

Software Engineering Principles

Interpersonal Skills

Communication

Education

Honors Degree in Computer Science

Honors Degree in Mathematics

Honors Degree in Engineering

Tools

Microsoft Azure

AWS

Relational Databases

Job description

Context & Environment

Accountabilities:

• Facilitate the connection, ingestion, and archiving of TMSA source data into the TotalEnergies Cloud in a safe, secure, and structured manner.
• Analyze and define data architecture requirements by evaluating business processes and existing data structures and applications.
• Support the development of Digital projects within TMSA.
• Support productionized Digital solutions within TMSA, including assisting with incident resolution and planning future enhancements.
• Ensure all solutions developed are in compliance with TotalEnergies Company Rules, or otherwise assist in the development or modification of these rules.
• Work with IT to ensure compliance with TotalEnergies Security Rules and Guidelines for all solutions developed.

Activities

Data Strategy:

• Design, develop, and implement end-to-end data solutions (storage, integration, processing, access) in AWS or equivalent.
• Architect and support the development of automated data pipelines (ETL, ELT) in collaboration with business stakeholders.
• Analyze and define data architecture requirements by evaluating business processes and existing data structures and applications.
• Propose architectures considering cost/spend in Azure/AWS or equivalent and develop recommendations to optimize data infrastructure.
• Design and implement data models to document the data architecture in its AS-IS and TO-BE states.
• Assist in defining a Cloud Data strategy, solutions, and roadmaps aligning with business, performance goals, and TotalEnergies IT strategy and Data Governance guidelines.
• Identify new digital techniques, tools, or best practices and assist in integrating them into the department's ways of working.

Functional Expertise:

• Provide expertise and guidance on leveraging cloud platform capabilities to business stakeholders.
• Act as liaison between key business users and IT for investigating, analyzing, and implementing cloud-based solutions, including documentation, data mapping, and source system modifications.

Solution Development:

• Assist in developing end-to-end solutions for new and existing digital projects.
• Run proof-of-concepts and explore opportunities for innovative cloud solutions.

Solution Support:

• Support incident resolution for productionized digital solutions.
• Ensure production services are optimally configured and aligned with best practices to protect data.
• Support the development of automated data pipelines in collaboration with stakeholders and IT teams.
• Work closely with IT to define and develop the digital support process for industrialization.

Candidate Profile

Qualifications/Experience required

Required:

• A numerate honors degree (e.g., Computer Science, Mathematics, Engineering).
• Ability to develop technical solutions and functional specifications based on business needs.
• Knowledge of leading technologies including:
• Enterprise data modeling
• Data ingestion and integration
• Data storage and security
• Data processing and distributed computing
• Software engineering principles and application architectures
• Hardware infrastructure and networking
• Extensive experience with relational databases, including administration.
• Proven experience and best practices knowledge of cloud platforms (Microsoft Azure & AWS).
• Experience integrating cloud services with on-premise data sources securely.
• Excellent interpersonal, communication, and technical presentation skills.
• Organized, methodical, and capable of multitasking under tight deadlines.

Preferred:

• Understanding of the Downstream industry and main strategic drivers.
• Knowledge of multi-tier, high-availability cloud and on-premise data engineering solutions in complex environments.
• Experience with Microsoft Azure and AWS tech stacks.
• Experience working within Agile teams.
• Proficiency in English.

Additional Information

Job dimensions:

• Develop and deliver cloud-based data engineering solutions.
• Provide support and guidance on data and technology topics across digital squads.
• Serve as the Centre of Excellence for cloud development within TMSA.
• Act as Chapter Lead for Data Engineers to ensure best practices in data architecture are applied consistently.

TotalEnergies values diversity, promotes individual growth, and offers equal opportunity careers.