Senior Data Engineer – Data Platform & Mesh Architect

minden.ai; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

minden.ai in Singapore seeks a Senior Data Engineer to design and scale a data platform based on data mesh principles and the modern data stack. You will build and maintain data pipelines, ingestion, transformation and storage from diverse sources, enabling self-serve analytics for product and business teams.

You will collaborate with data science, analytics and engineering teams to improve data quality, observability and governance, contribute to CI/CD and tooling, and evaluate new technologies

Qualifications

• Bachelor's degree in Computer Science, Data Science, or related field.
• 5+ years of experience as a Data Engineer with Data Modelling experience.
• Proficiency in SQL, Python and Java/Scala.
• Experience with Big Data processing frameworks and data warehouses.
• Experience with dimensional modeling, Data Warehouse concepts, SCDs and tradeoffs, modern data warehouse, and data lake / lakehouse / data mesh.
• Experience with modern data stack (Snowflake, dbt-core, Airflow) or similar technologies.

Responsibilities

• Design and implement a scalable data platform based on data mesh principles.
• Develop and maintain efficient data pipelines to ingest, transform, and store data from diverse sources.
• Collaborate with engineers to build self-service data platform features and APIs.
• Contribute to Data Products/Data Marts, data modeling and usability.
• Partner with data science and analytics teams to meet data needs.
• Improve data quality, observability, lineage, governance and lifecycle management.
• Contribute to CI/CD, testing, monitoring, documentation and code reviews.
• Evaluate and introduce new technologies to improve developer productivity and platform scalability.
• Follow data standards and full lifecycle of the Data Platform.

Skills

Data modelling

SQL

Python

Java/Scala

Big Data

Snowflake

dbt

Airflow

Data governance

Education

Bachelor's degree

Tools

None

Job description

minden.ai in Singapore seeks a Senior Data Engineer to design and scale a data platform based on data mesh principles and the modern data stack. You will build and maintain data pipelines, ingestion, transformation and storage from diverse sources, enabling self-serve analytics for product and business teams.

You will collaborate with data science, analytics and engineering teams to improve data quality, observability and governance, contribute to CI/CD and tooling, and evaluate new technologies