Senior Data Engineer: Real-Time Trading Data Platform

hermeneutic research; Singapore; On-site; SGD 120,000 - 190,000; Full time

Job summary

hermeneutic research in Singapore is seeking a Senior Data Engineer to architect and operate the full data infrastructure for Research and Trading. You will build scalable pipelines handling market data, news feeds, and internal sources, ensuring reliability and cost efficiency.

You will work hands-on across data lifecycle, collaborate with research and engineering, implement data quality checks, and optimize performance at scale.

Qualifications

• Strong problem-solving and analytical thinking.
• Clear communication for cross-functional collaboration.
• Proficiency in building robust data quality checks for ingested data.
• Experience identifying anomalies in ingested data.
• SQL and similar queries; optimize performance.
• Python or Java/Scala.
• ETL pipelines with Airflow, dbt, or scripts.
• Dimensional modeling concepts (star/snowflake).
• Experience with Snowflake/Redshift/BigQuery/Synapse.
• Spark/Kafka/Flink experience.
• Data security and privacy standards.

Responsibilities

• Design, build, and optimize scalable data pipelines ingesting market data, news feeds, and unstructured sources.
• Ensure data quality, consistency, and real-time monitoring with validation processes.
• Develop processes to organize data warehouse for cross-department use.
• Apply data management practices for scalable, available, and efficient storage.
• Support trading and research needs while maintaining data integrity and performance.
• Collaborate with research and analytics to understand data needs and enable exploration and modeling.
• Create tools to overlay data from multiple sources.
• Optimize hardware and software resources for cost-effective data management.
• Adopt latest technologies to meet data engineering needs.
• Align systems with best practices in data management.

Skills

Problem-solving

Communication

SQL proficiency

Python/Java/Scala

ETL pipelines (Airflow/dbt)

Dimensional modeling

Data platforms (Snowflake/Redshift/Big

Spark/Kafka/Flink

Data security & privacy

Education

CS/Engineering/Math degree

Tools

Apache Airflow

dbt

Terraform

Kubernetes

Job description

hermeneutic research in Singapore is seeking a Senior Data Engineer to architect and operate the full data infrastructure for Research and Trading. You will build scalable pipelines handling market data, news feeds, and internal sources, ensuring reliability and cost efficiency.

You will work hands-on across data lifecycle, collaborate with research and engineering, implement data quality checks, and optimize performance at scale.