Apache Spark Data Engineer Entry Level

Accenture Southeast Asia; Kota Semarang; On-site; IDR 100.000.000 - 200.000.000; Full time

Job summary

A multinational consulting company is seeking an Application Developer in Semarang, Indonesia to design and build applications using Google Dataproc. The ideal candidate should have strong experience in Apache Spark and Java, be familiar with various database models, and have a knowledge of cloud technologies. Responsibilities include collaborating with teams to implement data-driven solutions and maintaining documentation.

Qualifications

• Strong experience in Apache Spark and Java for Spark.
• Familiarity with various database models like SQL and NoSQL.
• Experience with Data Streaming Architecture.

Responsibilities

• Design, build, and configure applications with Google Dataproc.
• Collaborate with teams to deliver data-driven solutions.
• Maintain technical documentation for applications.

Skills

Apache Spark

Java for Spark

SQL

NoSQL

Data Streaming Architecture

Cloud technologies

Terraform

GCP Data Engineer Certification

Job description

Overview

As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using Google Dataproc.

Your typical day will involve working with Apache Spark and collaborating with cross-functional teams to deliver impactful data-driven solutions.

Responsibilities

• Design, build, and configure applications to meet business process and application requirements using Google Dataproc.
• Collaborate with cross-functional teams to deliver impactful data-driven solutions.
• Utilize Apache Spark for data processing and analysis.
• Develop and maintain technical documentation for applications.

Professional & Technical Skills

• Strong expereince in Apache Spark and Java for Spark.
• Strong experience with multiple database models ( SQL, NoSQL, OLTP and OLAP)
• Strong experience with Data Streaming Architecture ( Kafka, Spark, Airflow)
• Strong knowledge of cloud data platforms and technologies such as GCS, BigQuery, Cloud Composer, Dataproc and other cloud-native offerings
• Knowledge of Infrastructure as Code (IaC) and associated tools (Terraform, ansible etc)
• Experience pulling data from a variety of data source types including Mainframe (EBCDIC), Fixed Length and delimited files, databases (SQL, NoSQL, Time-series)
• Experience performing analysis with large datasets in a cloud-based environment, preferably with an understanding of Google’s Cloud Platform (GCP)
• Comfortable communicating with various stakeholders (technical and non-technical)
• GCP Data Engineer Certification is a nice to have