Associate PySpark Manager

Accenture Southeast Asia; Kota Semarang; On-site; IDR 100.000.000 - 200.000.000; Full time

Job summary

A leading consulting firm in Indonesia is seeking a data engineering expert to develop and deploy innovative data solutions using PySpark. The role involves collaborating with multiple teams and managing impactful data projects to enhance data accessibility and efficiency. Ideal candidates will have at least 4 years of relevant experience and a Bachelor’s degree in a related field. Join us to make significant contributions to our data-driven initiatives.

Qualifications

• Advanced proficiency in PySpark.
• Expert proficiency in Data Engineering.
• A minimum of 4 years of experience in relevant related skills.

Responsibilities

• Develop reusable workflows for data ingestion and optimization.
• Build scalable data pipelines for extraction and loading.
• Deploy data solutions into production environments.

Skills

PySpark

Data Engineering

Data Migrations

Data Pipelines

Education

Bachelor's Degree in relevant field of studies

Tools

Cloudera Data Platform

Job description

THE WORK

Ignite your passion for data and innovation! In this role, you will be a subject matter expert, collaborating with various teams to contribute to key decisions and provide solutions to challenges that arise. You will engage with multiple teams and manage decisions that impact your immediate group and beyond. Your expertise in PySpark will be essential as you work towards creating impactful data solutions. We invite you to join us in this exciting journey where your contributions will make a difference!

• Develop reusable workflows that encompass data ingestion, quality, transformation, and optimization.
• Build scalable data pipelines utilizing various tools for extraction, transformation, and loading.
• Deploy data solutions into production environments while ensuring efficiency and reliability.
• Migrate data from legacy data warehouses, applying cloud architecture principles.
• Automate data flow processes to enhance consumption and accessibility.

HERE'S WHAT YOU WILL NEED

• Advanced proficiency in PySpark.
• Expert proficiency in Data Engineering.
• A minimum of 4 years of experience in relevant related skills.
• Bachelor's Degree in relevant field of studies.

BONUS POINTS IF YOU HAVE

• Expert proficiency in Cloudera Data Platform.
• Advanced proficiency in Data Migrations.
• Advanced proficiency in Data Pipelines.