AWS Data Engineer – Senior Consultant

Deloitte Africa; Midrand; On-site; ZAR 600,000 - 900,000; Full time

Job summary

A leading consulting firm in Midrand is looking for an AWS Data Engineer to join their AI and Data practice. The role requires experience in implementing creative data solutions and collaborating with a diverse team to develop modern data platforms. Ideal candidates should have a Bachelor’s Degree in a quantitative field and 3+ years of relevant experience with data architectures and solutions on AWS. Inclusive workplace committed to diversity and respect.

Qualifications

• 3+ years’ experience in implementing data solutions using Big Data frameworks.
• Experience with both traditional and non-traditional data sources.
• Strong communication skills and ability to simplify technical concepts.

Responsibilities

• Implement end-to-end modern data platforms for analytics and AI.
• Collaborate with architects and data scientists on data structure.
• Mentor junior colleagues and participate in technical meetings.

Skills

Data ingestion

Data pipeline frameworks

Data warehouse architecture

Cloud services

Education

Bachelor’s Degree in Computer Science or related field

Tools

AWS Glue

SQL Server

Python

Hadoop

Job description

Company Description

At Deloitte, our Purpose is to make an impact that matters for our clients, our people, and society. This is the lens for which our global strategy is set. It unites Deloitte professionals across geographies, businesses, and skills. It makes us better at what we do and how we do it. It enables us to deliver on our promises to stakeholders, while creating the lasting impact we seek.

Harnessing the talent of 450,000+ people located across more than 150 countries and territories, our size and scale puts us in a unique position to help change the world for the better—by bringing together the services we provide, the societal investments we make, and the collaborations we advance through our ecosystems.

Deloitte offers career opportunities across Audit & Assurance (A&A), Tax & Legal (T&L) and our Consulting services business, which is made up of Strategy, Risk & Transactions Advisory (SR&T) andTechnology & Transformation (T&T).

Job Description

We are looking for an AWS Data Engineer to join ourAI and Data practice, who is passionate about data and technology solutions, with strong problem-solving and analytical skills, tech savvy with a solid understanding of software development,driven to learn more, keeps up with market evolution and industry trends.

You will have the opportunity to work throughout the entire engagement cycle, specializing in modern data solutions including data ingestion/data pipeline frameworks, data warehouse & data lake architectures, cognitive computing and cloud services.

Technical Requirements for the role:

• Support AI & Datateam and implement end-to-end modern data platforms in support of analytics and AI use cases
• Collaborate with enterprise architects, data architects, other ETL developers & engineers, data scientists and information designers to lead identification and definition of required data structures, formats, pipelines, metadata, and workload orchestration capabilities
• Address aspects such as data privacy & security, data ingestion & processing, data storage & compute, analytical & operational consumption, data modelling, data virtualization, self-service data preparation & analytics, AI enablement, and API integrations
• Estimate effort and mentor junior colleagues
• Participate in technical meetings with client staff, and advise client with technical option analyses based on leading practices
• Workas a data engineer on AWS but also on other technologies.
• Apply yourdeep knowledge of technology to drive continuous improvement.

Behavioural Competencies:

• Good communication skills, both written and verbal
• Interpersonal and relationship building skills
• Desire to develop self
• Client delivery focus
• Adaptable
• Focus on quality
• Problem solving ability
• Analytical

Qualifications

Bachelor’s Degree (or higher) in quantitative areas such as Computer Science, Information Management, Big Data & Analytics, or related field is desired.

One or more of the following AWS certifications is preferred but experience with building solutions on cloud platforms is mandatory:

• AWS Solutions Architect – Associate/Professional
• AWS Data Engineer Associate

Experience:

3+ years’ experience in implementation of creative data solutions leveraging the latest in Big Data frameworks, supporting on-premise or AWS cloud to enable use cases in analytics and AI

3+ years’ experience with extraction, transformation and loading of data from a wide variety of traditional and non-traditional sources such as structured, unstructured, and semi-structured using SQL, NoSQL and data pipelines for real-time, streaming, batch and on-demand workloads

3+ years’ experience with data warehousing or data lakes.

Ability to simplify complex technical concepts into easy-to-understand non-technical language in order to facilitate, communicate and interact with executives and business stakeholders, working with Agile development methods in data-oriented projects

Technical Competencies

Must Demonstrate experience in one or more services and technologies listed below:

• Database: SQL Server, NoSQL (Hbase, Cassandra or Mongo DB), Cloud BasedDatabases (Hive, Cosmos DB, Dynamo DB), Redshift/ Redshift Spectrum, AWS RDS
• Database Development: Experience Views, functions, stored procedures, Optimisation of queries, building indexes, OLAP / MDX
• Cloud: AWS / Azure / GCP /Snowflake (AWS is preferred)
• ETL: AWS Glue, Athena, SSIS, IBM DataStage / SAP Data Services, AWS DMS, Appflow
• Programming: SQL (TSQL /HQL etc), Python, Spark. UNIX & Shell Commands (Python / shell / Perl)
• Modelling: Data Vault, Kimball, 3rd Normal Form / OLAP / MDX)
• Big Data: Hadoop Platform (Cloudera / cloud equivalent), HiveQL /Spark / Ooozie / Impala / Pig), Optimising Big Data, Streaming (NiFi / Kafka)
• Data Acquisition: Pipeline creation, Automation and data delivery, Once off, CDC, Streaming

Engineering Competencies:

• Able to define a structured approach to problem solving
• Completion of data models and designs within client’s architecture and standards
• Build robust data pipelines and ETL’s using integration tools and services
• Understanding complex business environments and requirements and design a solution based on leading practices
• Ability to document design and implement solutions for client product owners
• Completion of deliverables for gaining architectural approval at client
• Understanding of DataOps approach to solution architecture.
• Solid experience in data and SQL is required
• Solid data modelling experience

Additional Information

At Deloitte, we want everyone to feel they can be themselves and to thrive at work—in every country, in everything we do, every day.We aim to create a workplace where everyone is treated fairly and with respect, including reasonable accommodation for persons with disabilities. Weseek to create and leverage our diverse workforce to build an inclusive environment across the African continent.

Note: The list of tasks / duties and responsibilities contained in this document is not necessarily exhaustive. Deloitte may ask the employee to carry out additional duties or responsibilities, which may fall reasonably within the ambit of the role profile, depending on operational requirements.

Be careful of Recruitment Scams: Fraudsters or employment scammers often pose as legitimate recruiters, employers, recruitment consultants or job placement firms, advertising false job opportunities through email, text messages and WhatsApp messages. They aim to cheat jobseekers out of money or to steal personal information.

To help you look out for potential recruitment scams, here are some Red Flags:

• Upfront Payment Requests:Deloitte will never ask for any upfront payment for background checks, job training, or supplies.
• Requests for Personal Information:Be wary if you are asked for sensitive personal information, especially early in the recruitment process and without a clear need for it. Fraudulent links or contractual documents may require the provision of sensitive personal data or copy documents (e.g., government issued numbers or identity documents, passports or passport numbers, bank account statements or numbers, parent’s data) that may be used for identity fraud. Do not provide or send any of these documents or data. Please note we will never ask for photographs at any stage of the recruitment process.
• Unprofessional Communication:Scammers may communicate in an unprofessional manner. Their messages may be filled with poor grammar and spelling errors. The look and feel may not be consistent with the Deloitte corporate brand.

If you're unsure, make direct contact with Deloitte using our official contact details. Be careful not to use any contact details provided in the suspicious job advertisement or email.