Senior Data Engineer

Talent Insider; Jakarta Selatan; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A leading HR consultancy firm in Jakarta Selatan seeks a data engineer to develop and maintain data pipelines, ensuring data quality and optimizing reporting. Candidates should have 1-4 years of experience, with strong SQL and programming skills. Familiarity with cloud platforms like AWS or GCP is essential, alongside expertise in Big Data tools. This is an opportunity to drive data solutions in a growing team.

Qualifications

• 1-4 years of experience with building data pipelines or data ingestion.
• Hands-on experience with SQL, Python, Java, Scala.
• Experience with cloud computing platforms like AWS, GCP, Azure.

Responsibilities

• Build bridges between various data sources.
• Ensure data consistency and quality.
• Design and maintain data pipelines for reporting.

Skills

SQL

Python

Java

Scala

AWS

GCP

Azure

Hadoop

Spark

Airflow

Tools

Big Data tools (Hadoop, Hive, Spark, Presto)

Data pipelines & orchestration tools (Ozzie, Airflow, Nifi)

Job description

Talent Insider is an upcoming HR Consultancy Service, founded in 2021. Our clients have been some of the leading brands in Indonesia, and this service continues to expand.

Registered in Singapore & Indonesia, we can assist with your growth plans and strategies, and continue to expand our regional presence with strong regional partners to assist our client in recruitment and branding strategy.

Job Description:

• Connect Diverse Data Sources: This Involves Building Bridges Between Various Data Sources, Regardless Of Their Format Or Location.
• Ensure Data Consistency And Quality: Make Sure Data Is Accurate, Complete, And Consistent Across All Platforms And Tools.
• Optimize Data Pipelines For Reporting: Design And Maintain Data Pipelines That Deliver High-quality Data For Timely And Accurate Reporting.
• Partner With Engineering And Business Teams: Work Closely With Other Departments To Build Data Solutions That Meet Their Specific Needs And Requirements.
• Develop Scalable And Optimized Data Solutions: Design Data Infrastructure That Can Grow And Adapt To The Changing Needs Of The Business.

Job Requirements:

• Over 1-4 years of experience with building the data pipelines or data ingestion for both Batch/Streaming data from different sources to data warehouse / data lake.
• Handson experience/knowledge with SQL/Python/Java/Scala programming, understanding of SQL is a must.
• Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, Bigquery), Azure (Blob/Azure, Synapse) etc.
• Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto).
• Data pipelines & orchestration tool (Ozzie, Airflow, Nifi).