Data Engineer

SwiftMind Indonesia; Tangerang Selatan; On-site; IDR 200.000.000 - 300.000.000; Full time

Job summary

A data-driven technology company located in Indonesia is seeking a Data Engineer to design and maintain data pipelines and optimize ETL processes. The ideal candidate will hold a Bachelor's degree in Computer Science or a related field and have a strong foundation in SQL, along with proficiency in programming languages like Python. The role requires great problem-solving abilities and effective communication skills, as collaboration with various teams is essential. Experience with big data technologies is a plus.

Qualifications

• Bachelor's degree in a relevant field is required.
• Strong foundation in SQL and familiar with databases like PostgreSQL or MySQL.
• Proficient in a programming language such as Python, Java or Scala.

Responsibilities

• Design and maintain data pipelines for analytics.
• Collaborate with teams to understand data requirements.
• Optimize data storage solutions for quality and accessibility.

Skills

SQL

Python

Data engineering

Problem solving

Communication

Education

Bachelor's degree in Computer Science, Data Engineering, or related field

Tools

PostgreSQL

MySQL

Git

ETL tools

BigQuery

Spark

Job description

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes to support analytics and business intelligence initiatives
• Implement and optimize data storage solutions, ensuring data quality, accessibility, and security
• Collaborate with Data Scientists, Analytics teams, and other stakeholders to understand data requirements and deliver effective solutions
• Build and maintain data warehouses and data lakes, ensuring efficient data organization and retrieval
• Write clean, maintainable, and well-documented code following team standards and best practices
• Participate in code reviews and provide constructive feedback to team members
• Monitor and optimize data pipeline performance and efficiency"Create and maintain comprehensive documentation for data processes and architectures
• Implement data validation and quality control measures
• Contribute to technical discussions and architectural planning sessions
• Share knowledge with team members and participate in mentoring activities

Requirements

• Bachelor's degree in Computer Science, Data Engineering, or related field
• Strong foundation in SQL and experience with relational databases (e.g., PostgreSQL, MySQL)
• Proficiency in at least one programming language (e.g., Python, Java, Scala)
• Experience with ETL tools and data pipeline development
• Understanding of data warehouse concepts and dimensional modeling
• Familiarity with version control systems (Git) and collaborative development workflows
• Basic knowledge of data security practices and compliance requirements
• Strong problem-solving skills and analytical thinking abilities
• Excellent communication skills in both technical and non-technical contexts
• Demonstrated interest in data engineering through projects or work experience

Preferred Skills

• Experience with big data technologies (e.g., BigQuery, Spark)
• Knowledge of stream processing frameworks (e.g., Kafka, RabbitMQ)
• Experience with data modeling and optimization techniques
• Knowledge of data governance principles
• Understanding of machine learning pipelines and requirements
• Experience with data visualization tools
• Understanding of CI/CD practices for data pipelines
• Knowledge of scripting languages for automation (e.g., Bash, Shell)
• Familiarity with Python web development (e.g., FastAPI, Flask) is a plus
• Proficiency with AI-powered coding assistants (e.g., GitHub Copilot, Cursor) is a plus
• Familiarity with data warehouse tools or relevant Apache frameworks (e.g., Airflow,Spark)