Data Engineer: Real-Time Big Data on AWS & DataBricks

Medium; Jambur Pulau; On-site; IDR 300,000,000 - 400,000,000; Full time

Benefits offered by this job

Opportunities for career advancement

Collaborative work environment

Culture that welcomes new ideas

Job summary

Medium is seeking a Data Engineer in Jambur Pulau, Sumatera Utara, Indonesia. The role involves designing and maintaining scalable data processing systems, collaborating with teams to understand data needs, and developing ETL pipelines using AWS technologies.

The ideal candidate will have a degree in Computer Science and at least 5 years of experience in data engineering, with proficiency in Apache Spark, AWS, and programming languages such as Scala or Python.

Join Medium to be part of an innovative organization committed to enhancing customer experiences through advanced data solutions.

Qualifications

• Minimum of 5 years of experience as a Data Engineer.
• Good understanding of Data‑bricks and Delta Lake.
• Familiar with data job scheduler tools like Dagster.

Responsibilities

• Design, develop, and maintain scalable data processing systems.
• Collaborate with analysts and developers to understand data requirements.
• Develop and maintain ETL pipelines for data extraction and loading.

Skills

Data processing systems design

Big data technologies

AWS services

Programming (Scala, Java, Python)

Data modeling

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Data‑bricks

Apache Spark

AWS (EC2, S3, Glue)

Metabase

Terraform

Job description

Medium is seeking a Data Engineer in Jambur Pulau, Sumatera Utara, Indonesia. The role involves designing and maintaining scalable data processing systems, collaborating with teams to understand data needs, and developing ETL pipelines using AWS technologies.

The ideal candidate will have a degree in Computer Science and at least 5 years of experience in data engineering, with proficiency in Apache Spark, AWS, and programming languages such as Scala or Python.

Join Medium to be part of an innovative organization committed to enhancing customer experiences through advanced data solutions.