Data Engineer

Devoteam; Jakarta Selatan; On-site; IDR 240,000,000 - 420,000,000; Full time

Job summary

Devoteam is seeking a Data Engineer to design scalable data architectures, build and maintain ETL pipelines, and manage data warehouses and lakes. You will integrate data from databases, APIs, and external systems, ensuring data quality and governance while collaborating with data scientists and business stakeholders.

The role emphasizes performance optimization, cross-functional collaboration, and delivering real-world data solutions in a growing tech consulting firm.

Qualifications

• Minimum two years of related experience.
• Two GCP certifications within 3 months after joining.
• Experience with ETL processes and data integration.
• Experience designing scalable data architectures and data warehouses.
• Knowledge of data governance and quality standards.
• Strong communication and collaboration with cross-functional teams.

Responsibilities

• Design scalable data architectures and data pipelines.
• Develop and maintain ETL processes from multiple sources.
• Manage data warehouses and data lakes for performance and security.
• Integrate data from diverse sources for unified datasets.
• Collaborate with data scientists and analysts to ensure data quality.
• Optimise data processing and storage for performance and scalability.
• Partner with cross-functional teams to deliver data solutions.

Skills

Python

SQL

Java/Scala

Data modeling

Data governance

Analytical thinking

Communication

Education

Bachelor's in Computer Science or related field

GCP Certification (2)

Tools

Apache Hadoop

Apache Spark

Apache Kafka

Airflow

NiFi

Talend

Informatica

Redshift

BigQuery

Snowflake

AWS

GCP

Azure

Job description

Devoteam is a global tech consulting firm drivingAI-driven transformation for sustainable value, guided by our visionTech for people.

We believe technology goes beyond solving problems—it enables better change for businesses, people, and society. Through ourAMPLIFY strategy, we empower clients to imagine and realise better change by combining creativity, leading technology, AI, and strategic thinking into impactful, real-world use cases.

With25+ years of experienceand8,000+ professionals across Europe and the Middle East, Devoteam fosters an environment where people grow, innovation thrives, and responsible technology creates long-term impact.

Job Description

The Data Engineer will be responsible for the following activities:

• Work closely with data architects and other stakeholders to design scalable and robust data architectures that meet the organization's requirements
• Develop and maintain data pipelines, which involve the extraction of data from various sources, data transformation to ensure quality and consistency, and loading the processed data into data warehouses or other storage systems
• Responsible for managing data warehouses and data lakes, ensuring their performance, scalability, and security
• Integrate data from different sources, such as databases, APIs, and external systems, to create unified and comprehensive datasets.
• Perform data transformations and implement Extract, Transform, Load (ETL) processes to convert raw data into formats suitable for analysis and reporting
• Collaborate with data scientists, analysts, and other stakeholders to establish data quality standards and implement data governance practices
• Optimise data processing and storage systems for performance and scalability
• Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver solutions

Qualifications

• Programming Skills: Proficiency in programming languages such as Python, Java, Scala, or SQL is essential for data engineering roles. Data engineers should have experience in writing efficient and optimized code for data processing, transformation, and integration.
• Database Knowledge: Strong knowledge of relational databases (e.g., SQL) and experience with database management systems (DBMS) is crucial. Familiarity with data modeling, schema design, and query optimization is important for building efficient data storage and retrieval systems.
• Big Data Technologies: Understanding and experience with big data technologies such as Apache Hadoop, Apache Spark, or Apache Kafka is highly beneficial. Knowledge of distributed computing and parallel processing frameworks is valuable for handling large-scale data processing.
• ETL and Data Integration: Proficiency in Extract, Transform, Load (ETL) processes and experience with data integration tools like Apache NiFi, Talend, or Informatica is desirable. Knowledge of data transformation techniques and data quality principles is important for ensuring accurate and reliable data.
• Data Warehousing: Familiarity with data warehousing concepts and experience with popular data warehousing platforms like Amazon Redshift, Google BigQuery, or Snowflake is advantageous. Understanding dimensional modeling and experience in designing and optimizing data warehouses is beneficial.
• Cloud Platforms: Knowledge of cloud computing platforms such as Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP) is increasingly important. Experience in deploying data engineering solutions in the cloud and utilizing cloud-based data services is valuable.
• Data Pipelines and Workflow Tools: Experience with data pipeline and workflow management tools such as Apache Airflow, Luigi, or Apache Oozie is beneficial. Understanding how to design, schedule, and monitor data workflows is essential for efficient data processing.
• Problem-Solving and Analytical Skills: Data engineers should have strong problem-solving abilities and analytical thinking to identify data-related issues, troubleshoot problems, and optimize data processing workflows.
• Communication and Collaboration: Effective communication and collaboration skills are crucial for working with cross-functional teams, including data scientists, analysts, and business stakeholders. Data engineers should be able to translate technical concepts into clear and understandable terms.

Education and Experience

• Minimum Two years of related experience is highly preferred.
• Two certifications in GCP (within 3 months after joining).

Additional Information

At the moment we are only able to hire candidates based in Jakarta for a full-time working hour.