Data Engineer: Cloud Pipelines & Data Warehouse

Devoteam; Indonesia; On-site; IDR 504.456.000 - 840.761.000; Full time

Job summary

A leading consulting firm in Indonesia is seeking a Data Engineer to design scalable data architectures and develop data pipelines. This role requires proficiency in programming languages like Python or SQL, and a strong knowledge of databases and big data technologies like Hadoop. Candidates should have at least two years of experience in related fields and be willing to obtain certifications in Google Cloud Platform shortly after joining. This full-time position offers opportunities for professional growth in a dynamic environment.

Qualifications

• Minimum of two years of experience in data engineering or related fields.
• Certifications in Google Cloud Platform within three months of joining.

Responsibilities

• Design scalable and robust data architectures.
• Develop and maintain data pipelines from various sources.
• Manage data warehouses and data lakes.
• Integrate data from different sources to create comprehensive datasets.
• Implement Extract, Transform, Load (ETL) processes.
• Establish data quality standards and implement data governance.
• Optimize data processing and storage systems for performance.
• Collaborate with cross-functional teams to understand data requirements.

Skills

Proficiency in Python, Java, Scala, or SQL

Strong knowledge of relational databases

Experience with big data technologies (Hadoop, Spark, Kafka)

Proficiency in ETL processes

Familiarity with data warehousing concepts

Knowledge of cloud computing platforms

Experience with data pipeline tools (Airflow, Luigi)

Strong problem-solving and analytical skills

Effective communication and collaboration skills

Education

Minimum Two years of related experience

Two certifications in GCP

Job description

A leading consulting firm in Indonesia is seeking a Data Engineer to design scalable data architectures and develop data pipelines. This role requires proficiency in programming languages like Python or SQL, and a strong knowledge of databases and big data technologies like Hadoop. Candidates should have at least two years of experience in related fields and be willing to obtain certifications in Google Cloud Platform shortly after joining. This full-time position offers opportunities for professional growth in a dynamic environment.