Data Engineer - Data Warehouse

PT Trinusa Travelindo; Jakarta Utara; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A leading data company in Jakarta Utara is seeking a Data Warehouse Engineer to define data models, design pipelines, and ensure data quality. You will work closely with various teams to optimize data processes and govern data effectively. The ideal candidate has 3-4 years of experience, is fluent in Python and advanced SQL, and possesses knowledge of data warehousing concepts.

Qualifications

• Minimum 3 to 4 years of experience in a relevant area.
• Familiarity with data warehouse environments is preferable.
• Ability to maintain good relationships with stakeholders.

Responsibilities

• Define data model convention and governance.
• Design and maintain data pipelines.
• Ensure data governance and quality.

Skills

Fluent in Python

Advanced SQL

Data modeling

Creative problem solving

Team player

Tools

Google BigQuery

AWS Redshift

Snowflake

dbt

Dataform

Spark

Hive

Google Dataflow

Docker

Kubernetes

Job description

Overview

It's fun to work in a company where people truly BELIEVE in what they're doing!

The data warehouse engineering team plays an important role in the data team. We build, govern and maintain data warehouse platforms and environments as the foundation and source for every data product created by data analysts and scientists.

Responsibilities

• Define data model convention and governance
• Design, develop and maintain data pipelines (external data source ingestion jobs, ETL/ELT jobs, etc)
• Design, develop and maintain data pipeline framework (combined open source and internal software to build and govern data pipelines)
• Create and manage data pipelines infrastructures
• Continuously seek ways to optimize existing data processing to be cost and time efficient
• Ensure good data governance and quality through build monitoring systems to monitor data quality in data warehouse.

Qualifications

• Minimum 3 to 4 years working experiences in a similar/relevant area
• Fluent in Python and advanced-SQL
• Preferably familiar with data warehouse environments (eg: Google BigQuery, AWS Redshift, Snowflake)
• Preferably familiar with data transformation or processing framework (eg: dbt, Dataform, Spark, Hive, etc)
• Preferably familiar with data processing technology (Google Dataflow, Google Dataproc, etc)
• Preferably familiar with orchestration tool (eg: Airflow, Argo, Azkaban, etc)
• Understand data warehousing concept (eg: Kimball, Inmon, data vault, etc) and experience in data modeling and measure + improve data quality
• Preferably understand basic containerization and microservice concept (eg: Docker, Kubernetes)
• Having knowledge in machine learning, building robust API, and web development will be an advantage
• Able to build and maintain good relationship with stakeholders
• Able to translate business requirements to data warehouse modeling specifications
• Able to demonstrate creative problem solving skill
• A team player who loves to collaborate with others and can work independently when needed