Data Engineer: Scale Data Pipelines & Insights

Bibit; Setia Budi; On-site; IDR 240,000,000 - 360,000,000; Full time

Job summary

Bibit.id is seeking a Data Engineer to design, build and maintain data architectures, pipelines and warehouses. You will work with data scientists to ensure reliable data for analytics.

Qualifications include 2+ years in big data, ETL, GCP with BigQuery, and Python. You will also collaborate to improve data quality and support decision making with SQL and visualization tools like Tableau or Metabase.

Qualifications

• 2+ years of data engineering experience with exposure to Big Data, real-time data pipelines, ETL processes and tools like Airflow.
• Experience with Cloud Service environment, especially GCP + BigQuery; other cloud services are a plus.
• Experience with third party analytics tools and data stores.
• Strong SQL skills and ability to write efficient queries.
• Experience with data visualization tools such as Tableau, Holistics, Metabase.

Responsibilities

• Construct and maintain efficient data pipelines and warehouses for data collection.
• Develop necessary scripts/mini-apps to run data analysis.
• Conduct tests on large scale data platforms.
• Provide recommendations to improve data quality.
• Ensure and support the data architecture utilized by data scientists and analysts.
• Development of data processes for data modeling, mining, and data production.

Skills

Big Data

Real-time pipelines

ETL processes

Python programming

SQL querying

Airflow

GCP BigQuery

RDBMS & NoSQL

Tableau

Metabase

Pig Latin

Tools

Tableau

Holistics

Metabase

Airflow

Job description

Bibit.id is seeking a Data Engineer to design, build and maintain data architectures, pipelines and warehouses. You will work with data scientists to ensure reliable data for analytics.

Qualifications include 2+ years in big data, ETL, GCP with BigQuery, and Python. You will also collaborate to improve data quality and support decision making with SQL and visualization tools like Tableau or Metabase.