Data Engineer

EMQ2 TECHNOLOGY SERVICES PTE. LTD.; Singapore; On-site; USD 60,000 - 100,000; Full time

Job summary

An innovative company is seeking a skilled Data Engineer to design and deploy robust data solutions. You will play a crucial role in developing efficient data pipelines, integrating data silos, and collaborating with cross-functional teams to create scalable data-driven products. This position offers the opportunity to work with cutting-edge AWS technologies and engage in an Agile environment. If you are passionate about data engineering and looking to make a significant impact, this role is perfect for you.

Qualifications

• 5-8 Jahre Erfahrung in der Datenverarbeitung und -engineering.
• Starke Programmierkenntnisse in Python oder Java.

Responsibilities

• Entwickeln und Bereitstellen von Datenpipelines für große Datenmengen.
• Zusammenarbeiten mit verschiedenen Teams zur Entwicklung datengestützter Produkte.

Skills

Data Engineering

AWS Glue

AWS S3

Python

Java

ETL/ELT Processes

Data Quality Assurance

Job description

Interested candidates, please apply via join.sandp1t.com

Job Description

Design, develop, and deploy data tables, views, and marts in data warehouses, operational data stores, data lakes, and data virtualization platforms.

Perform data extraction, cleaning, transformation, and flow. Web scraping may also be part of the data extraction scope.

Design, build, launch, and maintain efficient and reliable large-scale batch and real-time data pipelines using data processing frameworks.

Integrate and collate data silos in a scalable and compliant manner.

Collaborate with Project Managers, Data Architects, Business Analysts, Frontend Developers, Designers, and Data Analysts to build scalable data-driven products.

Develop backend APIs and work on databases to support applications.

Work in an Agile environment practicing Continuous Integration and Delivery.

Engage with fellow developers through pair programming and code reviews.

Requirements

• 5-8 years of hands-on experience in data engineering.
• Proficiency in AWS data services such as AWS Glue, AWS S3, and optionally AWS Lake Formation.
• Strong programming skills in languages like Python or Java.
• Experience with ETL/ELT processes and data quality assurance.