IT Big Data Sr. Engineer

Home Credit Indonesia; Jakarta Pusat; On-site; IDR 240,000,000 - 360,000,000; Full time

Job summary

Home Credit Indonesia is seeking an experienced Data Engineer to design, build, and govern enterprise-scale data pipelines and platforms on Microsoft Fabric and Azure. You will lead data architecture and governance efforts while collaborating across teams to enable analytics, reporting, and advanced data initiatives.

The role requires strong cloud data experience, security and compliance awareness, and the ability to work in a fast-paced environment.

Qualifications

• Bachelor's degree in information technology, Computer Science, or a related field.
• 5-8 years of relevant experience in IT Data Engineering, Big Data Platforms, Data Warehouse or Cloud Data Solution.
• At least 2 years' experience designing/developing/maintaining enterprise-scale data pipelines using cloud-based platforms.
• Experience in Microsoft Fabric, Azure Data Platform or equivalent technologies is preferred.

Responsibilities

• Design and maintain enterprise-scale data architecture, data models, and integration patterns that support analytics, reporting, and advanced data initiatives.
• Provide technical leadership and architecture guidance for data platform initiatives, ensuring scalability, reliability, security, and maintainability.
• Establish and enforce data governance, metadata management, data lineage, data quality, and security standards across the data platform.
• Define and implement data lifecycle management, retention, archival, and recovery strategies.
• Build, maintain, and optimize batch and real-time data pipelines using Microsoft Fabric components, including Dataflow Gen2, Data Pipelines, Notebooks, and Eventstream.

Skills

Big Data

Data Engineering

Cloud Platforms

Azure

Data Governance

Education

Bachelor's degree in IT/CS

Tools

Microsoft Fabric

Azure Data Platform

Kafka

Job description

You will involve inNew Big Data Technology on Cloud that covers:

• Design and maintain enterprise-scale data architecture, data models, and integration patterns that support analytics, reporting, and advanced data initiatives.
• Provide technical leadership and architecture guidance for data platform initiatives, ensuring scalability, reliability, security, and maintainability.
• Establish and enforce data governance, metadata management, data lineage, data quality, and security standards across the data platform.
• Define and implement data lifecycle management, retention, archival, and recovery strategies.
• Build, maintain, and optimize batch and real-time data pipelines using Microsoft Fabric components, including Dataflow Gen2, Data Pipelines, Notebooks, and Eventstream.
• Implement and manage real-time data ingestion and streaming solutions using Eventstream and Kafka integration.
• Design, develop, and manage Lakehouse and Warehouse solutions on OneLake, including data replication and mirroring from enterprise source systems such as Oracle.
• Configure and manage On-premises Data Gateway to enable secure and reliable connectivity between on-premises and cloud-based data sources.
• Collaborate with cross-functional teams on the migration and modernization of legacy data warehouse platforms (Hadoop/Cloudera) to Microsoft Fabric.
• Manage source control, release management, and CI/CD processes through Git integration and Fabric Deployment Pipelines.
• Optimize Fabric workloads, Spark jobs, storage architecture, and data processing performance to achieve scalability and cost efficiency.
• Monitor platform health, service availability, capacity utilization, and resource consumption through Fabric Capacity Metrics and other monitoring tools and recommend optimization initiatives.
• Ensure data platform reliability, availability, recoverability, and compliance with agreed service levels.
• Produce and maintain technical documentation, including architecture diagrams, solution designs, operational runbooks, standards, and data dictionaries.
• Lead root cause analysis, troubleshooting, and incident resolution activities related to data platforms, pipelines, integrations, and cloud infrastructure.
• Mentor junior engineers, conduct technical reviews, and promote engineering best practices, coding standards, and knowledge sharing within the team.
• Evaluate emerging technologies, tools, and architectural approaches to continuously improve the organization's data platform capabilities.

We are looking for Talent with:

• Bachelor's degree in information technology, Computer Science, or a related field.
• Minimum of 5 - 8 years of relevant experience in IT Data Engineering, Big Data Platforms, Data Warehouse or Cloud Data Solution
• At least 2 years' experience designing/developing/maintaining enterprise-scale data pipelines using cloud-based platforms.
• Experience in Microsoft Fabric, Azure Data Platform or equivalent technologies is preferred.
• Strong understanding of enterprise-level applications, data management, and IT infrastructure.
• In-depth knowledge of cybersecurity best practices and compliance requirements.
• Excellent communication and interpersonal skills.
• Strategic thinking and problem-solving abilities.
• Ability to thrive in a dynamic and fast-paced environment.