A technology company in Singapore is seeking a Data Engineer to design and maintain data pipeline architecture, optimize data processes, and support various teams in data infrastructure challenges. The role requires advanced SQL skills, experience with big data, and strong analytic capabilities. Ideal candidates will thrive in a dynamic environment and possess excellent project management skills. This position offers opportunities for creating impactful data solutions.
Qualifications
Advanced SQL knowledge with relational databases and various database systems.
Experience in building and optimizing big data pipelines and architectures.
Strong analytic skills for working with unstructured datasets.
Responsibilities
Design, develop and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet business requirements.
Automate manual processes and optimize data delivery.
Skills
SQL knowledge
Big data pipeline experience
Root-cause analysis
Analytic skills with unstructured datasets
Project management
Data transformation processes
Cross-functional team collaboration
Job description
Data Engineer / Senior Data Engineer
Qualifications
Advanced working SQL knowledge and experience working with relational databases, query authoring as well as familiarity with a variety of databases.
Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
Experience performing root‑cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Strong analytic skills related to working with unstructured datasets.
Build processes supporting data transformation, data structures, metadata, dependency, and workload management. Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
Strong project management and organizational skills.
Experience supporting and working with cross‑functional teams in a dynamic environment.
Responsibilities
Design, develop and maintain optimal data pipeline architecture.
Assemble large, complex data sets that meet business requirements.
Identify, design, and implement internal process improvements: automate manual processes, optimize data delivery, redesign infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Work with stakeholders—including the executive and development teams—to assist with data‑related technical issues and support their data infrastructure needs.
Create data tools for analytics and facilitate ML development using the data.