Data Engineer

PT Japfa Comfeed Indonesia, Tbk; Daerah Khusus Ibukota Jakarta; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A leading company in the agricultural sector is seeking a skilled Data Engineer located in Jakarta. The successful candidate will design and optimize data pipelines, integrate data from diverse sources, and ensure data quality across various environments. Strong proficiency in SQL, cloud services, and data tools is essential. Join us to impact data-driven decisions while collaborating with talented analysts and scientists.

Qualifications

• Proven experience as a Data Engineer or related role.
• Strong understanding of APIs and SQL.
• Experience with cloud platforms and Big Data tools.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Integrate data from various sources, ensuring quality and availability.
• Collaborate with data teams to deliver clean data and insights.

Skills

Data pipeline design

Data integration

Data security

SQL

Python

API proficiency

Big Data tools

Education

Bachelor's Degree in Computer Science or related field

Tools

Hadoop

Spark

Kafka

AWS

Azure

BigQuery

Snowflake

Job description

Key Responsibilities
1. Design, build, and maintain scalable and reliable data pipelines.
2. Integrate data from various sources, including APIs, relational databases, and NoSQL databases.
3. Ensure data availability and quality across data warehouse, data lake, and lakehouse environments.
4. Optimize ETL/ELT processes and data pipelines for maximum performance and efficiency.
5. Ensure data replication processes between systems or environments run correctly and efficiently.
6. Collaborate with data analysts and data scientists to deliver clean, usable data and actionable insights.
7. Communicate effectively with principals and external stakeholders in English, particularly for system integration, troubleshooting, and technical documentation.
8. Maintain data security and ensure compliance with company policies and standards.

Qualifications
1. Proven experience as a Data Engineer, Data Analyst, or in a related role.
2. Proficient in both spoken and written English (required for communication with international partners).
3. Strong understanding of APIs (REST, SOAP, or GraphQL).
4. Proficient in SQL and at least one programming language, preferably Python.
5. Solid knowledge of relational databases (e.g., PostgreSQL, MySQL) and/or NoSQL databases (e.g., MongoDB, Redis).
6. Familiar with Big Data concepts and tools such as Hadoop, Spark, or Kafka.
7. Experience with cloud platforms (AWS, GCP, Azure), particularly in data-related services such as BigQuery, Redshift, or Snowflake.
8. Understanding of data warehouse, data lake, and lakehouse architectures.
9. Experience managing or monitoring data replication between systems or environments.
10. Capable of performing data maintenance, optimization, and profiling.
11. Experience with data integration tools (e.g., IBM, Informatica, Qlik Replicate, etc).

Additional Value
1. Experience with data workflow orchestration tools (e.g., Airflow, etc).
2. Familiarity with CI/CD practices for data pipelines.
3. Knowledge of data governance and data quality best practices.

What's your expected monthly basic salary?

Which of the following types of qualifications do you have?

How many years' experience do you have as a Data Engineer?

How many years' experience do you have using SQL queries?

Which of the following data analytics tools are you experienced with?

Which of the following Relational Database Management Systems (RDBMS) are you experienced with?

Which of the following programming languages are you experienced in?

Agriculture, Forestry & Fishing More than 10,000 employees