Data Engineer/ Senior Data Engineer

Softvil Technologies; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Softvil Technologies in Singapore is seeking a Data Engineer/Senior Data Engineer to design, develop and maintain data pipelines and architectures. You will assemble large, complex data sets and identify improvements across data delivery, infrastructure, and scalability.

The role involves creating analytics tools and supporting ML development using the data. Strong SQL, experience with big data pipelines, and working with unstructured data are highly valued.

Qualifications

• Advanced SQL knowledge with relational databases and query authoring.
• Experience building and optimizing large-scale data pipelines and data sets.
• Ability to perform root cause analysis on data and processes to improve business outcomes.
• Strong analytical skills with unstructured data handling.
• Experience with data transformation, metadata, dependency and workload management.
• Familiarity with message queuing, stream processing and scalable data stores.
• Strong project management and organizational abilities.
• Experience working with cross-functional teams in dynamic environments.

Responsibilities

• Design, develop and maintain optimal data pipeline architecture.
• Assemble large, complex data sets meeting business requirements.
• Identify and implement internal process improvements for automation and scalability.
• Build infrastructure for ETL from varied data sources.
• Create analytics tools using the data pipeline to derive actionable insights.
• Collaborate with executives and development teams to support data infrastructure needs.
• Create data tools to support analytics and ML development.

Skills

SQL

Big data pipelines

Root cause analysis

Unstructured data

Data transformation

Message queues

Project management

Cross-functional collaboration

Job description

Data Engineer/Senior Data Engineer

Qualifications

• Advanced working SQL knowledge and experience working with relational databases, Query authoring (SQ L) as well as working familiarity with a variety of databases.
• Experience building and optimizing ‘big data’ data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with Unstructured datasets.
• Build processes supporting data transformation, data structures, metadata, dependency, and workload management. Working knowledge of message queuing, stream processing and highly scalable ‘big data’ data stores.
• Strong project management and organizational skills.
• Experience supporting and working with cross-functional teams in a dynamic environment.

Responsibilities

• Design, develop and maintain optimal data pipeline architecture,
• Assemble large, complex data sets that meet business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.
• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with stakeholder s including the Executive and Development teams to assist with data-related technical issues and support their data infrastructure needs.
• Create data tools for analytics and facilitate ML development using the data.