Data Engineering Lead, Singapore

OP RaaS; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ofi is seeking a Data Engineering Lead to spearhead the data engineering team and oversee the design and implementation of data infrastructure. You will work with data scientists, analysts, and stakeholders to ensure data flow and integrity across the organization.

Responsibilities include building pipelines in Snowflake on Azure, integrating SAP ERP, Salesforce, and OT systems; optimizing performance; and leading a team while ensuring governance and security.

Qualifications

• Bachelor’s or Master’s degree in a relevant field.
• 6+ years of experience in data engineering, 2+ years in a lead role.
• Knowledge of SAP ERP integration with Snowflake.
• Understanding of customer experience, manufacturing, supply chain, and financial concepts.
• Proficiency with data pipeline tools, especially Snowflake ecosystem.
• Experience with SQL databases and multiple programming languages.
• Familiarity with data quality tools such as Informatica.

Responsibilities

• Design and build data architecture with Snowflake on Azure for ingestion, transformation and delivery.
• Develop real-time and batch data ingestion from SAP ERP, Salesforce and OT systems into Snowflake.
• Transform data by normalization, aggregation and preparation for analysis.
• Optimize Snowflake performance and data retrieval for pipelines.
• Collaborate with business leaders to align data strategies with objectives.
• Ensure governance and security with legal and cyber security teams.
• Stay updated on data engineering innovations and apply improvements.
• Lead and mentor the data engineering team.
• Establish data quality rules, standards and thresholds.
• Develop data quality metrics and monitoring processes.
• Implement data validation and cleansing using Informatica.
• Conduct data profiling to identify issues and coordinate fixes.
• Implement data lineage and metadata management to track origin and transformations.

Skills

Data pipeline tooling

Programming languages

Team leadership

Education

Bachelor’s or Master’s degree in Computer Science / Data Analytics / Data Science / Information Technology

Tools

SAP ERP (S4HANA/ECC) integration

Informatica

Snowflake

SQL databases

Job description

About the job

Data Engineering Lead

At ofi, we are on a mission to leverage data to drive innovation and business transformation. We are looking for a Data Engineering Lead to spearhead our data engineering team and contribute to our mission of delivering data-driven solutions. As a Data Engineering Lead, you will be responsible for managing the data engineering team and overseeing the design and implementation of our data infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure the seamless flow and integrity of data across the organization.

Key Responsibilities:

Data Infrastructure Management:

• 
  Design and Build Data Architecture: Construct robust data pipelines in the Snowflake environment (hosted in MS Azure) to support scalable data ingestion, transformation, and delivery.
• 
  Data Collection and Integration: Develop systems to collect data from various sources (including SAP ERP, Salesforce, other IT systems as well as OT systems) using real-time or batch ingestion technologies, ensuring it is accurately integrated into the Snowflake platform.
• 
  Data Transformation: Implement processes to normalize, aggregate, and transform data into a format suitable for analysis and reporting.
• 
  Performance Optimization: Optimize data retrieval and query performance within Snowflake, ensuring efficient operation of data pipelines.
• 
  Collaboration with Stakeholders: Work closely with business leaders to understand company objectives and align data engineering strategies accordingly.
• 
  Governance and Security: Partner with legal and cyber security teams to maintain high standards of data governance and security, ensuring compliance with relevant regulations.
• 
  Innovation and Improvement: Stay abreast of the latest technology innovations in data engineering and apply them to improve existing systems and processes.
• 
  Team Leadership: Lead and mentor a team of data engineers, fostering a culture of technical excellence and continuous learning.

Data Quality Assurance:

• 
  Collaborate with subject matter experts to establish data quality rules, standards, and thresholds for the data domains.
• 
  Develop and implement data quality metrics /standards, processes, and tools to monitor and improve the quality and accuracy of data across systems and platforms.
• 
  Implement data validation and cleansing routines to identify and rectify data errors, duplicates, outliers, and missing values, leveraging data quality tools such as Informatica.
• 
  Conduct data profiling and analysis to identify data quality issues, inconsistencies, and anomalies and work with relevant teams to address them.
• 
  Implement data lineage and metadata management solutions to track the origin, transformations, and usage of data across the organization.

Requirements

• 
  Bachelor’s or master’s degree in Computer Science, Data Analytics, Data Science, Information Technology, etc.
• 
  Proven 6+ years of experience in data engineering, with 2+ years as the Data Engineering Lead.
• 
  Knowledge of SAP ERP (S4HANA and ECC) including its integration with Snowflake.
• 
  Functional understanding of customer experience, manufacturing, supply chain, and financial concepts
• 
  Proficiency in data pipeline tools and technologies, particularly within the Snowflake ecosystem.
• 
  Extensive experience with SQL databases and multiple programming languages.
• 
  Experience in working with data quality tools such as Informatica.