Senior Data Engineer

Ajaib Group; Jakarta Pusat; On-site; IDR 240,000,000 - 480,000,000; Full time

Benefits offered by this job

ML/AI workflows

Data modeling

ETL processes

Data warehousing

Java

Go

5+ years experience

Job summary

Ajaib Group is seeking a Senior Data Engineer in Jakarta to design and implement scalable data pipelines and optimize data storage and retrieval systems. You will collaborate with analytics and software engineering teams to drive data-driven decisions.

Responsibilities include building robust data workflows with Spark and Airflow, managing infrastructure with Kubernetes and CI/CD tools, and ensuring data quality across cloud-based platforms.

Qualifications

• Proficient in Python and SQL for data manipulation and pipeline development.
• Solid experience with Terraform, Jenkins, ArgoCD, and GitHub Actions for CI/CD pipelines.
• Hands-on expertise in Apache Spark and Airflow to design and manage data workflows.
• Strong knowledge of Kubernetes, Kafka, and Pub/Sub for scalable data infra.
• Proficient in PostgreSQL and MySQL for data storage and querying.
• Cloud experience with GCP for data platforms.

Responsibilities

• Design and implement scalable data pipelines.
• Optimize data storage and retrieval systems.
• Collaborate with analytics and software engineering teams.

Skills

Python

SQL

ML/AI workflows

Data modeling

ETL processes

BigQuery

Snowflake

Redshift

Java

Go

CI/CD knowledge

Tools

Terraform

Jenkins

ArgoCD

GitHub Actions

Apache Spark

Airflow

Kubernetes

Kafka

Pub/Sub

PostgreSQL

MySQL

GCP

Job description

Senior Data Engineer

We’re seeking a Senior Data Engineer to join our innovative team.

Responsibilities

• Design and implement scalable data pipelines
• Optimize data storage and retrieval systems
• Collaborate with analytics and software engineering teams

Requirements

• Proficiency in Python and SQL
• Proficiency in Terraform, Jenkins, ArgoCD, and GitHub Actions for CI/CD
• Proficiency in Apache Spark and Airflow for pipelines
• Proficiency in Kubernetes, Kafka, and Pub/Sub for infrastructure
• Proficiency in PostgreSQL and MySQL for databases
• Proficiency in GCP for cloud environment

Nice to Have

• Familiarity with ML/AI workflows
• Strong understanding of data modeling and ETL processes
• Familiarity with data warehousing solutions (e.g., Bigquery, Snowflake, Redshift)
• Proficiency in Java and Go
• 5+ years experience in data engineering