Senior Data Engineer - AWS, Python, Scalable Pipelines

ScienTec Consulting Pte. Ltd.; Singapore; On-site; SGD 54,000 - 89,000; Full time

Benefits offered by this job

AWS certification support

Central Location

Job summary

ScienTec Consulting is seeking a Senior Data Engineer to design, build, and maintain scalable data platforms for BI, analytics, and AI initiatives. You will develop reliable data pipelines, optimize infrastructure, and ensure high-quality data is available for business users and data teams.

The role requires 6+ years in data engineering, strong Python/SQL skills, and hands-on AWS, Databricks, Snowflake experience.

Qualifications

• Bachelor's degree in CS/IT/IS or related field.
• At least 6 years of experience in data engineering or related roles.
• Strong programming skills in Python and SQL.
• Experience with ETL/ELT tools and workflow orchestration platforms such as Airflow or similar.
• Hands-on experience with cloud data platforms such as AWS, Databricks, Snowflake, or equivalent.
• Good understanding of data warehousing, data lakes, data modelling, and performance optimization.
• Experience with big data technologies such as Spark or Hadoop is an advantage.
• Knowledge of data governance, security, and compliance best practices.
• Strong analytical, problem-solving, and communication skills.
• Ability to work independently and collaborate effectively in a cross-functional team.

Responsibilities

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and delivery.
• Build and automate ETL/ELT processes to improve efficiency and reliability.
• Optimize data warehouses and data lakes for performance, scalability, and cost efficiency.
• Ensure data quality, security, governance, and compliance with company standards.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Collaborate with data scientists, analysts, software engineers, and business stakeholders to support analytics and AI projects.
• Develop reusable data models and datasets for reporting and business insights.
• Maintain technical documentation and follow data engineering best practices.
• Evaluate and implement new technologies to improve data platforms and engineering processes.

Skills

Python

SQL

Airflow

AWS

Databricks

Snowflake

Spark

Hadoop

Data modelling

Data warehousing

Education

Bachelor's Degree in Computer Science / IT / IS

Tools

Airflow

Databricks

Snowflake

Spark

Hadoop

Job description

We are looking for an experiencedSenior Data Engineerto design, build, and maintain scalable data platforms that support business intelligence, analytics, and AI initiatives. You will play a key role in developing reliable data pipelines, optimizing data infrastructure, and ensuring high-quality data is readily available for business users and data teams.

Working Hours: Mon-Fri
Working Location: Central
Salary Package: Up to $8,000 (basic) + AWS + VB

Key Responsibilities

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and delivery.
• Build and automate ETL/ELT processes to improve efficiency and reliability.
• Optimize data warehouses and data lakes for performance, scalability, and cost efficiency.
• Ensure data quality, security, governance, and compliance with company standards.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Collaborate with data scientists, analysts, software engineers, and business stakeholders to support analytics and AI projects.
• Develop reusable data models and datasets for reporting and business insights.
• Maintain technical documentation and follow data engineering best practices.
• Evaluate and implement new technologies to improve data platforms and engineering processes.

Requirements

• Bachelor's Degree in Computer Science, Information Technology, Information Systems, or a related field.
• At least6 yearsof experience in data engineering or related roles.
• Strong programming skills inPythonandSQL.
• Experience with ETL/ELT tools and workflow orchestration platforms such asAirflowor similar.
• Hands-on experience with cloud data platforms such asAWS,Databricks,Snowflake, or equivalent.
• Good understanding of data warehousing, data lakes, data modelling, and performance optimization.
• Experience with big data technologies such asSparkorHadoopis an advantage.
• Knowledge of data governance, security, and compliance best practices.
• Strong analytical, problem-solving, and communication skills.
• Ability to work independently and collaborate effectively in a cross-functional team.

Preferred Qualifications

• Experience supporting analytics, machine learning, or AI projects.
• AWS or other cloud certifications are an advantage.
• Familiarity with CI/CD, Infrastructure as Code, and container technologies is a plus.

If you are passionate about building scalable data solutions and enabling data-driven decision-making, we'd love to hear from you. Apply now with your resume.

By submitting your resume, you consent to the collection, use, and disclosure of your personal information per ScienTec’s Privacy Policy (scientecconsulting.com/privacy-policy).

This authorizes us to:

• Contact you about potential opportunities.
• Delete personal data as it is not required at this application stage.
• All applications will be processed with strict confidence. Only shortlisted candidates will be contacted.

Elane Yap Theng Yu- R1989397

ScienTec Consulting Pte Ltd - 11C5781