Senior Data Engineer: Real-Time Pipelines & Data Platforms

TOPPAN ECQUARIA PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

TOPPAN ECQUARIA PTE. LTD. is seeking a data engineering professional to design, build and maintain large-scale batch and real-time data pipelines in Singapore.

You will ingest, clean and transform data using Spark and big data frameworks, and design data tables in data lakes and data warehouses to support analytics. Responsibilities include developing backend APIs and integrating databases to support applications, collaborating with Agile teams, and ensuring data governance and security best

Qualifications

• Degree or Diploma in CS/CE/IT/Business Analytics or related.
• 2–8 years' experience designing, developing or maintaining data platforms.
• Led a team of data engineers.
• Experience with Spark, Scala or PySpark.
• Experience with Hadoop, Azure Data Factory, Azure Synapse.
• Data modeling/design and management (Data Mart, Data Lake, Data Warehousing).
• Experience building production-grade data pipelines using cloud platforms such as Azure.
• Experience with Agile teams.
• Knowledge of data governance, access control and security best practices.
• Stakeholder engagement/requirements analysis.

Responsibilities

• Design, build and maintain efficient and reliable large-scale batch and real-time data pipelines.
• Ingest, clean, transform data to ensure pipelines are efficient, reliable and scalable.
• Design, develop and deploy data tables in data lake/data warehouses.
• Design and develop backend APIs and database integrations to support applications/use cases.

Skills

Technical leadership

Agile methodologies

Stakeholder engagement

Education

Degree or Diploma in CS/CE/IT/Business Analytics

Tools

Spark

Scala/PySpark

Hadoop

Azure Data Factory

Azure Synapse

Data Lake

Job description

TOPPAN ECQUARIA PTE. LTD. is seeking a data engineering professional to design, build and maintain large-scale batch and real-time data pipelines in Singapore.

You will ingest, clean and transform data using Spark and big data frameworks, and design data tables in data lakes and data warehouses to support analytics. Responsibilities include developing backend APIs and integrating databases to support applications, collaborating with Agile teams, and ensuring data governance and security best