Data Engineer

FindITGeek; Pluit; On-site; IDR 180,000,000 - 240,000,000; Full time

Job summary

FindITGeek is seeking a Data Engineer to develop and maintain ETL/ELT processes and data integration workflows. You will optimize SQL queries, build data pipelines with Spark (PySpark/Scala) and Python/R, and work with IBM InfoSphere tools and Informatica Data Engineering Integration.

The role requires 1+ year in data engineering or related fields, strong SQL, and experience with SSIS. You will collaborate with technical teams and business stakeholders to ensure data quality and support data

Qualifications

• Experience in Data Engineering and ETL/Data Integration.
• Strong SQL knowledge and data processing experience.
• Experience with SSIS and IBM InfoSphere tools.
• Experience with Informatica Data Engineering Integration.
• Experience with Apache Spark (PySpark, Spark R, or Scala).
• Proficiency in Python and/or R.
• Understanding of ETL, data modeling, data architecture, and data warehousing.

Responsibilities

• Develop and maintain ETL/ELT processes and data integration workflows.
• Optimize SQL queries and data processing pipelines.
• Build data processing solutions using Spark and Python/ R.
• Automate data flows across platforms and ensure data quality.
• Collaborate with technical teams and stakeholders to support data requirements.

Job description

Job Description

Develop and maintain ETL/ELT processes and data integration workflows. Develop and optimize SQL queries for data processing. Build and maintain ETL processes using SSIS and Informatica. Work with IBM InfoSphere tools, including DataStage, IA, BPM, RAD/Workbench, PME, and DB2. Develop big data processing solutions using Apache Spark, including PySpark, Spark R, or Scala. Develop data processing scripts using Python and/or R. Support data modeling, data architecture, and data warehousing activities. Automate data flows and data integration across different platforms. Monitor, troubleshoot, and optimize data processing and integration processes. Ensure data quality, consistency, and integrity. Work closely with technical teams and business stakeholders to support data requirements.

Requirements

Minimum 1 year of experience in Data Engineering, ETL, Data Integration, or a related field. Equivalent skills or experience may be considered. Good knowledge of SQL and data processing. Experience with SSIS. Experience with IBM InfoSphere Family (DataStage, IA, BPM, RAD/Workbench, PME, DB2). Experience with Informatica Data Engineering Integration. Experience with Apache Spark using PySpark, Spark R, or Scala. Experience with Python and/or R. Understanding of ETL, data modeling, data architecture, and data warehousing. Knowledge of data integration, data flow automation, and data processing. Knowledge of various database technologies. Good analytical and problem-solving skills.