Senior Data Engineer

Glints; Batam; On-site; IDR 501.002.000 - 835.004.000; Full time

Job summary

A technology recruitment firm is seeking a highly skilled Senior Data Engineer to join a dynamic team in Batam, Indonesia. This role involves designing and building data infrastructure, developing ETL pipelines, and ensuring data integrity. The ideal candidate has a strong background in SQL, Python, and experience with cloud-based solutions. If you are passionate about data engineering, apply now!

Qualifications

• Minimum 5 years of experience in Data Engineering or SQL.
• Strong programming skills in Python for data processing.
• Experience designing ETL pipelines in cloud environments.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines.
• Write complex SQL queries for data extraction and reporting.
• Optimize and automate data workflows using relevant tools.

Skills

SQL

Python

Data Engineering

ETL Pipelines

Problem-solving

Communication skills

Education

Bachelor's degree in IT, Computer Science, or a related field

Tools

SQL Server

PostgreSQL

Oracle

Azure Data Factory

Azure Databricks

Git

Spark

Hadoop

Docker

Kubernetes

Job description

We are seeking a highly skilled and experienced Senior Data Engineer to join our client's team in Batam, Indonesia. You will play a critical role in designing and building data infrastructure, ensuring data integrity, and optimizing workflows in cloud environments to support business objectives.

Key Responsibilities:

• Design, develop, and maintain scalable ETL pipelines and data processing systems.
• Write complex SQL queries for data extraction, manipulation, and reporting.
• Work closely with cross-functional teams to understand data requirements and deliver efficient solutions.
• Optimize and automate data workflows using Python and other relevant tools.
• Implement and manage cloud-based data solutions, ensuring robust data pipelines and integration processes.
• Collaborate with stakeholders to understand business needs and translate them into technical requirements.

Key Qualifications:

• Bachelor's degree in IT, Computer Science, or a related field.
• Min. 5 years of experience in Data Engineering, SQL, or a related field.
  Advanced proficiency in SQL for writing complex queries and optimizing data operations.
• Strong programming skills in Python for data processing and automation.
• Proven experience designing and implementing ETL pipelines in cloud environments.
• Expertise with databases such as SQL Server, PostgreSQL, Oracle, etc.
• Deep understanding of data modeling concepts and best practices.
• Familiarity with version control systems (e.g., Git) and CI/CD pipelines.
• Excellent problem-solving skills with high attention to detail.
• Strong communication and interpersonal skills to collaborate with technical and non-technical teams.

Nice to have:

• Experience working with big data tools (e.g., Spark, Hadoop).
• Knowledge of containerization technologies (Docker, Kubernetes).
• Familiarity with machine learning frameworks and data science tools.
• Experience with Azure Cloud Services, such as Azure Data Factory,
• Azure Databricks, Azure SQL Database, and Data Lake.

If you are passionate about data engineering and looking to contribute to a dynamic and growing team, apply now!