Senior Data Engineer (Banking, 1-year renewable contract)

Evolution Singapore; Singapore; On-site; SGD 120,000 - 190,000; Full time

Job summary

Evolution Singapore is hiring a senior data engineer to implement enterprise-scale Lakehouse platforms, data products, and data marketplace capabilities. You will design and maintain scalable data ingestion pipelines (batch, streaming, CDC, API-based) and build data contracts with strong governance.

You will also develop data architectures for NLP/AI analytics, support ML platforms, and expose data through APIs and BI tools, across distributed teams.

Qualifications

• Bachelor’s degree required in CS/Engineering/IT or related field.
• 8–12 years of experience in Data Engineering, Big Data, Lakehouse, or large-scale platforms.
• Hands-on with Databricks, Snowflake, Cloudera, cloud platforms (Azure/AWS/GCP).
• Proven data product and data marketplace experience.
• Strong Spark, PySpark, SQL, Python, or Scala skills.

Responsibilities

• Implement and operationalize enterprise-scale Lakehouse platforms and data products.
• Design, develop, test, and maintain scalable batch and streaming pipelines.
• Build data contracts, SLAs, data quality controls, and governance standards.
• Develop data architectures for NLP and AI-driven analytics including multimodal data.
• Support ML platforms, model deployment, and operationalization.
• Expose data via APIs, dashboards, and BI tools.
• Create and maintain technical docs and runbooks.
• Collaborate with distributed teams across projects.

Skills

Spark / PySpark

SQL

Python

Scala

Data modeling

Data governance

Stakeholder mgmt

Agile

Education

Bachelor’s degree in Computer Science / Engineering / IT

Tools

Databricks

Snowflake

Iceberg

Hudi

Delta Lake

Kafka

Flink

Airflow

Kubernetes

Docker

Terraform

Jenkins

Git

Job description

• Implement and operationalize enterprise-scale Lakehouse platforms, data products, and data marketplace capabilities.
• Design, develop, test, and maintain scalable batch, streaming, CDC, and API-based data ingestion pipelines.

• Build and maintain foundation and business data products with defined data contracts, SLAs, data quality controls, and governance standards.
• Implement and work with modern open table formats, including Iceberg, Hudi, and Delta Lake.
• Develop and support data pipelines for RAG, vector search, Generative AI (GenAI), and agentic AI use cases.
• Perform performance tuning, optimization, production support, troubleshooting, and root cause analysis across data platforms and pipelines.
• Implement data ingestion, transformation, reconciliation, and data quality frameworks.
• Develop data architectures supporting NLP and AI-driven analytics, including the ingestion, curation, governance, and management of structured and unstructured data.
• Support ML platforms and workflows, including model development, deployment, and operationalization.
• Develop internal engineering tools and full-stack applications using Python, shell scripting, and modern web frameworks.
• Expose and integrate data through APIs, event streams, dashboards, and BI platforms.
• Create and maintain technical documentation, deployment guides, and
• operational runbooks.
• Ensure compliance with engineering standards, DevSecOps controls, CI/CD
• practices, security requirements, and software delivery standards.
• Collaborate effectively with distributed engineering, data, technology, and
• business teams across multiple projects.
• automation, and operational excellence.

• Content extraction from various file formats.
• Regex-based extraction of specific fields.
• Content extraction from embedded images.
• Frame extraction from video files.
• Transcript extraction from audio files.

Key Requirements

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related discipline.
• 8–12 years of experience in Data Engineering, Big Data, Data Lake, Lakehouse, or large-scale data platform implementations.
• Strong hands‑on experience with enterprise data platforms such as Databricks, Snowflake, Cloudera, Azure, AWS, GCP, Huawei, or Alibaba Cloud.
• Hands‑on experience designing and developing data products and data marketplace capabilities.
• Strong expertise in Spark, PySpark, SQL, Python, and/or Scala, with strong overall programming skills.
• Proven experience building scalable data ingestion, transformation, streaming, CDC, reconciliation, and data quality pipelines.
• Hands‑on experience with Iceberg, Hudi, Delta Lake, and object storage platforms.
• Experience with modern data technologies such as Kafka, Flink, Spark Streaming, Airflow, Trino, Dremio, Hive, and/or Impala.
• Strong hands‑on experience with Kubernetes, OpenShift, Docker, Terraform, Jenkins, Git, CI/CD, MLflow, and observability tools.
• Experience designing data architectures and pipelines supporting NLP, AI-driven analytics, RAG, vector search, GenAI, and agentic AI use cases.
• Experience handling and governing unstructured and multimodal data, including documents, images, audio, and video.
• Experience with ML platforms and frameworks such as CML, Spark MLlib, scikitlearn, and XGBoost, including model deployment. Strong knowledge of data modelling, metadata management, data lineage, data governance, and data quality.
• Experience exposing data through APIs, event streams, dashboards, and BI platforms.
• Experience with full-stack/internal engineering tool development using Python, shell scripting, Flask, React, or similar technologies is advantageous.
• Knowledge or experience with Teradata, Netezza, Greenplum, or MPP migration programmes is advantageous.
• Strong engineering, automation, troubleshooting, and performance optimization mindset.
• Strong communication and stakeholder management skills, with the ability to work effectively across distributed teams and multiple projects.
• Experience working in Agile delivery environments and enterprise-scale technology platforms.
• Strong commitment to quality, operational excellence, automation, and continuous improvement.
• Relevant certifications such as Databricks Certified Data Engineer, Azure Data Engineer Associate, AWS Data Analytics Specialty, Google Professional Data Engineer, SnowPro, or DAMA CDMP would be an advantage.