Data Engineer (IT Consulting)

Luminare Consulting; Jakarta Selatan; On-site; IDR 20,000,000 - 30,000,000; Full time

Job summary

An IT consulting company in Indonesia is seeking a Data Engineer to design and maintain ETL processes and data platforms. The role requires a Bachelor's degree in Computer Science and at least 2 years of experience in data engineering. Candidates should be proficient with languages like Python and SQL, as well as ETL tools, and have expertise in server cluster technologies such as Hadoop and Spark. This position offers opportunities for collaboration with cross-functional teams.

Qualifications

• Minimum of 2 years of experience as a Data Engineer.
• Strong expertise in building data platforms based on server clusters.
• Familiarity with major cloud service providers.

Responsibilities

• Design, develop, and maintain robust ETL processes for data transformation.
• Build and manage data platforms based on server clusters.
• Collaborate with cross-functional teams to understand data requirements.

Skills

Python

SQL

Data visualization

ETL processes

Hadoop

Spark

Kafka

Education

Bachelor's degree in Computer Science or related major

Tools

SSIS

Pentaho

Talend

PowerBI

Looker Studio

BigQuery

Job description

About the job Data Engineer (IT Consulting)

On behalf of our client, an IT Consulting company that is looking to hire a Data Engineer position with details below

Responsibilities

• Design, develop, and maintain robust ETL processes for data transformation, quality, and reliability.
• Build and manage data platforms based on server clusters such as Hadoop, Spark, and Kafka.
• Utilize major cloud service providers (AWS, GCP, Azure) for data platform management.
• Deliver high-quality, well-tested, reusable, and secure code in compliance
• Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications.
• Ensure data integrity and availability for various applications and stakeholders.
• Monitor and troubleshoot data pipelines to ensure seamless data flow.
• Continuously improve data engineering processes and practices.

Qualifications

• Bachelors degree in Computer Science, Information Technology, or a related major.
• Minimum of 2 years of experience as a Data Engineer.
• Proficiency in development languages such as Python, SQL, or other relevant languages.
• Extensive experience in building and managing ETL processes.
• Familiar with ETL tools such as SSIS, Pentaho or Talend
• Experinece in data visualisation such as PowerBI, Locker Studio or Bigquery
• Strong expertise in building data platforms based on server clusters (Hadoop, Spark, Kafka).
• Familiarity with major cloud service providers (AWS, GCP, Azure).
• Ability to deliver high-quality, well-tested, reusable, and secure code.
• Strong technical expertise with various data sources and data types.