Senior Data Engineer

minden.ai; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

minden.ai in Singapore seeks a Senior Data Engineer to design and scale a data platform based on data mesh principles and the modern data stack. You will build and maintain data pipelines, ingestion, transformation and storage from diverse sources, enabling self-serve analytics for product and business teams.

You will collaborate with data science, analytics and engineering teams to improve data quality, observability and governance, contribute to CI/CD and tooling, and evaluate new technologies

Qualifications

• Bachelor's degree in Computer Science, Data Science, or related field.
• 5+ years of experience as a Data Engineer with Data Modelling experience.
• Proficiency in SQL, Python and Java/Scala.
• Experience with Big Data processing frameworks and data warehouses.
• Experience with dimensional modeling, Data Warehouse concepts, SCDs and tradeoffs, modern data warehouse, and data lake / lakehouse / data mesh.
• Experience with modern data stack (Snowflake, dbt-core, Airflow) or similar technologies.

Responsibilities

• Design and implement a scalable data platform based on data mesh principles.
• Develop and maintain efficient data pipelines to ingest, transform, and store data from diverse sources.
• Collaborate with engineers to build self-service data platform features and APIs.
• Contribute to Data Products/Data Marts, data modeling and usability.
• Partner with data science and analytics teams to meet data needs.
• Improve data quality, observability, lineage, governance and lifecycle management.
• Contribute to CI/CD, testing, monitoring, documentation and code reviews.
• Evaluate and introduce new technologies to improve developer productivity and platform scalability.
• Follow data standards and full lifecycle of the Data Platform.

Skills

Data modelling

SQL

Python

Java/Scala

Big Data

Snowflake

dbt

Airflow

Data governance

Education

Bachelor's degree

Tools

None

Job description

minden.ai is a technology venture founded by Temasek in strategic partnership with DFI Retail Group and coalition partners DBS Bank, Cold Storage, Gojek, Mandai Wildlife Group and Singtel. We are on a mission to redefine the engagement between brands and consumers in Southeast Asia.

The way we work:

At Minden, we treat each other with respect. We embrace authenticity and transparency. We pride ourselves on agility and innovation, and believe in embracing continuous learning and self-improvement. We strive to be the preferred employer by providing comprehensive benefits, a dynamic and exciting working environment, work-life balance and effort recognition.

We are seeking for individuals with grit and passion, an insatiable intellectual curiosity and a heart for people to amplify effectiveness as a team.

As a Senior Data Engineer, you will::

• Contribute to the design and implementation of a scalable and reliable data platform based on the data mesh principles with modern data stack.
• Develop and maintain efficient data pipelines to ingest, transform, and store data from various sources.
• Collaborate with engineers across domains to understand their data needs and develop self-service data platform features, improve developer experience, build data access tools and APIs.
• Contribute to the development and improvement of internal Data Products/Data Marts, Data Modeling and Data Product’s Usability
• Partner with the data science and analytics teams and other upstream internal and external customers of the data platform to ensure their data needs are met.
• Improve data quality, observability, lineage, governance and lifecycle management across the platform.
• Contribute to engineering best practices including CI/CD, testing, monitoring, documentation and code reviews.
• Contribute to evaluating and introducing new technologies that improve developer productivity and platform scalability.
• Follow and contribute to the continuous improvement of data standards and best practices, and the full life cycle of Data Platform

What you should have::

• Bachelor's degree in Computer Science, Data Science, or related field
• 5+ years of experience as a Data Engineer with Data Modelling experience, additional experience as backend software engineer is preferred
• Proficiency in programming languages like SQL, Python and Java or Scala
• Experience with Big Data processing frameworks and data warehouses
• Experience with dimensional modeling, Data Warehouse concepts, SCDs and tradeoffs, modern data warehouse, and data lake, lake house, data mesh.
• Experience with modern data stack (eg. Snowflake, dbt-core, Airflow, etc) or similar technologies is a plus.
• Experience in building, productionising and maintaining data lifecycle management and relevant tools.
• Understanding of data mesh principles and concepts is beneficial.
• Experience working in a fast-paced environment with evolving priorities and requirements is an advantage.