Lead PySpark Data Engineer

Accenture Southeast Asia; Kota Semarang; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A leading professional services company in Indonesia is seeking a Data Engineer to design and maintain data solutions. The role involves creating data pipelines, ensuring data quality, and collaborating with various teams. Ideal candidates are proficient in PySpark, familiar with cloud services, and possess strong skills in ETL processes and data integration.

Benefits

Formal and informal training programs

Opportunities for career development

Qualifications

• Strong understanding of data pipeline architecture and design.
• Experience with ETL processes and data integration techniques.
• Familiarity with data quality frameworks and best practices.

Responsibilities

• Design, develop, and maintain data solutions.
• Create data pipelines, ensure data quality, implement ETL processes.
• Collaborate with cross-functional teams to meet data needs.

Skills

Proficiency in PySpark

Data pipeline architecture

ETL processes

Data integration techniques

Data quality frameworks

Cloud platforms

Job description

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments, and organizations build their digital core, optimize operations, accelerate revenue growth, and enhance citizen services—creating tangible value at speed and scale. With approximately 791,000 people serving clients in more than 120 countries, we are a talent- and innovation-led company.

Technology is at the core of change today, and we are one of the world’s leaders in driving that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data, and AI with unmatched industry experience, functional expertise, and global delivery capability. Our broad range of services includes Strategy & Consulting, Technology, Operations, Industry X, and Song, enabling us to deliver tangible outcomes and build trusted, lasting relationships.

Job Description: Data Engineer

As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to understand their data needs and provide effective solutions, ensuring that the data infrastructure is robust and scalable to meet organizational demands.

• Collaborate and manage the team to perform effectively.
• Make responsible decisions for the team.
• Engage with multiple teams and contribute to key decisions.
• Provide solutions to problems for their immediate team and across multiple teams.
• Mentor junior team members to enhance their skills and knowledge.
• Continuously evaluate and improve data processes to enhance efficiency and effectiveness.

Required Skills

• Proficiency in PySpark
• Strong understanding of data pipeline architecture and design
• Experience with ETL processes and data integration techniques
• Familiarity with data quality frameworks and best practices
• Knowledge of cloud platforms and services related to data storage and processing

We also offer opportunities to hone your functional skills and expertise through formal and informal training programs at every level. Learning occurs on the job and through structured training, online courses, or collaboration with teammates. Our diverse projects provide an excellent platform to build your career.

Accenture is an equal opportunities employer and welcomes applications from all sections of society, without discrimination based on race, religion, ethnicity, disability, age, citizenship, marital status, sexual orientation, gender identity, or any other protected characteristic.