Data Engineer | Singapore, SG | In-Office

Data Engineer

As a Data Engineer, you will be a key contributor in building the Data Platform as a foundation for Data Analytics and AI.

Responsibilities:

• Design, develop, and maintain data pipelines and backend services for real-time decisioning, reporting, data collecting, and related functions.
• Data Requirements and Modeling
• Data Management and Transformation
• Produce high-quality, well-tested, and secure code.
• Develop and maintain software designed to improve data governance and security.
• Develop processes designed to ensure Data Security and Data Quality.

Requirements:

• BS/MS in Computer Science, Data Analytics, Data Management, Information Systems or related technical field or equivalent training & experience.
• 8+ years incorporating data processing and workflow management tools into pipeline design.
• 8+ years’ experience in ETL/ELT, Data warehousing, and/or Business Intelligence Development.
• 8+ years building and maintaining end-to-end data systems and supporting services in Python, Scala or similar.
• 8+ years using SQL to understand data and to investigate data issues or problems and provide solutions.
• 5+ years working with cloud data technologies.
• Experience with structured, semi-structured, and unstructured data.
• Experience utilizing a variety of data stores, including data warehouses, RDBMSes, in-memory caches, and searchable document databases.
• Experience working with large data sets in SQL/Databricks/PySpark.
• Experience with Spark Streaming, and Delta (Live) Tables.
• Experience with storage systems such as Azure Storage/Data Lakes.
• Experience with data modeling.
• Strong design, implementation, and testing skills.
• Experience developing for continuous integration and automated deployments.
• Experience developing on cloud platforms (preferably Azure) in a continuous delivery environment.
• Excellent communication and collaboration skills.
• Experience with microservices platforms (Kubernetes, Docker, Helm Charts).
• Experience with Event-Driven streaming systems (Kafka, Event Hub, Event Grid, Apache Flink).
• Knowledge and use of DBT.
• Experience with data vault is a plus.
• Experience with Microsoft Fabric.
• Experience with creating, editing and administering BI tools.