Lead PySpark Data Engineer – Build Scalable Data Pipelines

7500 PT Accenture Company; Kota Semarang; On-site; IDR 180,000,000 - 360,000,000; Full time

Job summary

Accenture is seeking a Data Engineer to design, develop, and maintain data solutions that facilitate data generation, collection, and processing. You will build data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems, collaborating with cross-functional teams to understand data needs and deliver scalable infrastructure.

Join a global team that values learning, mentorship, and continuous improvement, with opportunities to grow technical skills

Qualifications

• Proficiency in PySpark.
• Strong understanding of data pipeline architecture and design.
• Experience with ETL processes and data integration techniques.
• Familiarity with data quality frameworks and best practices.
• Knowledge of cloud platforms and services related to data storage and processing.

Responsibilities

• Collaborate and manage the team to perform data engineering tasks.
• Responsible for team decisions related to data initiatives.
• Engage with multiple teams and contribute on key data decisions.
• Provide solutions to data problems for the immediate team and across teams.
• Mentor junior team members to enhance their skills and knowledge.
• Continuously evaluate and improve data processes to enhance efficiency and effectiveness.

Skills

PySpark

Data pipeline

ETL processes

Data quality frameworks

Cloud platforms

Job description

Accenture is seeking a Data Engineer to design, develop, and maintain data solutions that facilitate data generation, collection, and processing. You will build data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems, collaborating with cross-functional teams to understand data needs and deliver scalable infrastructure.

Join a global team that values learning, mentorship, and continuous improvement, with opportunities to grow technical skills