Solution Architect (Cloud, Data, Python, Scala)

Quesscorp Singapore Pte Ltd; Singapore; On-site; SGD 140,000 - 190,000; Full time

Job summary

Quesscorp Singapore Pte Ltd is seeking an experienced data engineer to design and build cloud-based data infrastructure for ETL from diverse sources. The role focuses on architecting an APAC Enterprise Data Platform to deliver automated, scalable data pipelines and actionable insights.

You will collaborate with Finance, Risk, SCM and Product, leveraging SQL, Python, Scala and Java to develop robust data models and ML-ready data assets. Strong communication and teamwork are essential for success.

Qualifications

• Bachelor's degree required, master's preferred in CS/Engineering/Math or related field.
• 8+ years of experience with cloud solutions and data ecosystems including ERP environments.
• 8+ years of experience designing data-intensive solutions using distributed computing.
• 6+ years programming with SQL, Python, Scala and Java.
• Experience with Spark, Flink, Kafka for distributed streaming.
• OLAP systems experience (Cubes, MSSQL).
• Data warehouse experience (Redshift, Hive, Snowflake).
• Experience building data visuals (Power BI, SSRS).
• Strong analytical skills and understanding of statistics.
• Experience building ML models.
• Strong communication with clients and internal teams; team-oriented.

Responsibilities

• Participate in design and build of cloud infra for data ETL from diverse sources using SQL, Python and Talend.
• Re-architect APAC Enterprise Data Platform to deliver cloud-based intelligent systems and data pipelines.
• Interface with Finance, Risk, SCM and Product to design data models for actionable insights and metrics.
• Maintain strong SQL skills and familiarity with multiple DBs and big data technologies.
• Leverage cloud architectures to deliver ML models at scale.
• Collaborate with data architecture, enterprise architecture, data science and domain experts to align IT roadmaps.
• Own delivery of a modern data engineering model following CI/CD practices.
• Identify automation opportunities to reduce manual processes and drive business performance.
• Participate in project workstreams and track milestones and deliverables.

Skills

Cloud architecture

Distributed computing

SQL

Python

Scala

Java

Kafka

Spark

Flink

OLAP

Data warehouse

Power BI

SSRS

Machine learning

Statistical methods

Communication

Teamwork

Independent work

Education

Bachelor's degree

Master's degree

Tools

Talend

Job description

Key Responsibilities:

• Participate in the design and building of infrastructure (cloud) required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Python and ETL tools (Talend)
• Re Architect OSOT by designing APAC specific Enterprise Data Platform to to deliver cloud-based intelligent systems and build data pipelines, architectures, and data sets from raw, loosely structured data & build processes supporting data transformation, data structures, metadata, dependency and analyze disparate and diverse data assets to automate insights and drive business performance
• Interface with the cross-functional teams including Finance, Risk, SCM and Product to design and build data models that provide actionable insights into key business performance metrics, as well as supporting the needs of the commercial team
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of databases leveraging big data technologies
• Leverage cloud-based architectures and technologies to deliver optimized ML models at scale
• Works closely with leaders within data architecture, enterprise architecture, data science/analyst and domain experts, to build and maintain roadmaps against the IT strategy
• Own the delivery of a modern data engineering model that follows Dev/Ops principles and standards for continuous integration/ continuous delivery (CI/CD) processes
• Should be a strategic thinker with holistic vison, specific focus on the identification for the automation of existing manual processes to drive key business performance
• Participate in Project Working groups and assist in tracking the Project Mile Stones and deliverables

Key Requirements:

• Bachelor's degree required with a master's degree (or equivalent) in computer science, engineering (all branches), math or a related field preferred.
• 8+ years of experience with public and private cloud solutions, including building and maintaining a data ecosystem that includes an ERP environment
• 8+ years of experience in designing and building data-intensive solutions using distributed computing
• 6+ years of experience in programming with SQL, Python, Scala and Java
• Experience with distributed data streaming frameworks like Spark Structured Streaming, Apache Flink, Kafka
• OLAP system experience (Cubes, MSSQL)
• Data warehouse usage and optimization experience (RedShift, Hive, Snowflake)
• Experience building data visualizations or analytics e.g. Power BI, SSRS
• Strong analytic skills and understanding statistical methodologies.
• Experience building machine learning models
• Ability to communicate effectively with external clients and internal teams and manage expectations
• Demonstrated ability to work as an effective team member, share knowledge and information with the team and help others meet team priorities.
• Able to work independently & be an effective decision maker