Senior Data Engineer

JAC Recruitment Pte Ltd; Singapore; On-site; SGD 60,000 - 120,000; Full time

Job summary

An innovative firm is seeking a Senior Data Engineer to design and implement robust data pipelines and infrastructure for machine learning projects. In this pivotal role, you will collaborate with data scientists and engineers to ensure the availability and performance of data systems. Your expertise in cloud platforms and big data technologies will be essential in architecting scalable solutions that drive business insights. Join a dynamic team committed to leveraging data for transformative innovations and enjoy a vibrant workplace that values collaboration and professional growth.

Qualifications

• 5+ years of experience in data engineering with strong coding skills.
• Expertise in cloud platforms, especially AWS and GCP.

Responsibilities

• Design and maintain data pipelines for machine learning projects.
• Collaborate with teams to ensure data systems are reliable and performant.

Skills

Infrastructure as Code

Shell scripting

Python

SQL

Data streaming technologies

Problem-solving

Communication skills

Education

Bachelor's degree in Computer Science

Master's degree in Computer Science

Tools

AWS

GCP

Terraform

CloudFormation

Kafka

Kinesis

Spark

Hadoop

Docker

Kubernetes

Job description

COMPANY OVERVIEW

Our client is renowned for its exceptional customer experience, innovative facilities, and commitment to sustainability. Key features include a complex with extensive retail and dining options, and unique attractions.

We are currently looking for a Senior Data Engineer.

JOB RESPONSIBILITIES

1. Design, implement, and maintain data pipelines and infrastructure for machine learning projects. You’ll collaborate with data scientists, ML engineers, cloud engineers, and other teams to ensure data systems are available, reliable, and performant. Your role is crucial for developing and deploying advanced ML models that drive business insights and innovations.
2. Architect and implement scalable data solutions using advanced analytics and ML techniques.
3. Partner with data scientists and ML engineers to optimize feature engineering and model deployment.
4. Manage data infrastructure, including data warehouses and data lakes.
5. Optimize data pipelines for performance, scalability, and cost-effectiveness.
6. Collaborate with DevOps and IT teams for smooth deployment and maintenance of data pipelines.
7. Ensure compliance with data governance, security, and privacy regulations.
8. Stay updated with advancements in data engineering and ML, and adopt best practices.
9. Mentor junior team members and contribute to the organization’s data strategy.

JOB REQUIREMENTS

1. At least 5 years of professional experience with strong skills in Infrastructure as Code (e.g., Terraform, CloudFormation), Shell scripting, Python, and SQL.
2. Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
3. Extensive hands-on experience with cloud platforms, especially AWS and GCP, including their data services and analytics tools.
4. In-depth knowledge of big data technologies, distributed computing, and modern data architecture patterns. Proven success in designing and implementing large-scale data solutions, such as data pipelines, data warehouses, and data lakes.
5. Demonstrated ability to deliver projects successfully, meet milestones, and drive initiatives from inception to production.
6. Experience with data streaming technologies (e.g., Kafka, Kinesis) and batch processing frameworks (e.g., Spark, Hadoop).
7. Familiarity with containerization and orchestration technologies (e.g., Docker, Kubernetes).
8. Strong problem-solving skills and the ability to translate complex business requirements into technical solutions.
9. Excellent communication skills with the ability to collaborate effectively across cross-functional teams.

Benefits

Work Location: Singapore

*We regret that only shortlisted applicants will be contacted.

Syahirah Binte Ahmad Ja'afar (R22105331)
JAC Recruitment Pte. Ltd. (90C3026)