Senior Data Engineer - AWS, Python, Scalable Pipelines

ScienTec Consulting; Singapore; On-site; SGD 54,000 - 89,000; Full time

Benefits offered by this job

AWS certification support

Central Location

Job summary

ScienTec Consulting is seeking a Senior Data Engineer to design, build, and maintain scalable data platforms for BI, analytics, and AI initiatives. You will develop reliable data pipelines, optimize infrastructure, and ensure high-quality data is available for business users and data teams.

The role requires 6+ years in data engineering, strong Python/SQL skills, and hands-on AWS, Databricks, Snowflake experience.

Qualifications

• Bachelor's degree in CS/IT/IS or related field.
• At least 6 years of experience in data engineering or related roles.
• Strong programming skills in Python and SQL.
• Experience with ETL/ELT tools and workflow orchestration platforms such as Airflow or similar.
• Hands-on experience with cloud data platforms such as AWS, Databricks, Snowflake, or equivalent.
• Good understanding of data warehousing, data lakes, data modelling, and performance optimization.
• Experience with big data technologies such as Spark or Hadoop is an advantage.
• Knowledge of data governance, security, and compliance best practices.
• Strong analytical, problem-solving, and communication skills.
• Ability to work independently and collaborate effectively in a cross-functional team.

Responsibilities

• Design, develop, and maintain scalable data pipelines for data ingestion, transformation, and delivery.
• Build and automate ETL/ELT processes to improve efficiency and reliability.
• Optimize data warehouses and data lakes for performance, scalability, and cost efficiency.
• Ensure data quality, security, governance, and compliance with company standards.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.
• Collaborate with data scientists, analysts, software engineers, and business stakeholders to support analytics and AI projects.
• Develop reusable data models and datasets for reporting and business insights.
• Maintain technical documentation and follow data engineering best practices.
• Evaluate and implement new technologies to improve data platforms and engineering processes.

Skills

Python

SQL

Airflow

AWS

Databricks

Snowflake

Spark

Hadoop

Data modelling

Data warehousing

Education

Bachelor's Degree in Computer Science / IT / IS

Tools

Airflow

Databricks

Snowflake

Spark

Hadoop

Job description

ScienTec Consulting is seeking a Senior Data Engineer to design, build, and maintain scalable data platforms for BI, analytics, and AI initiatives. You will develop reliable data pipelines, optimize infrastructure, and ensure high-quality data is available for business users and data teams.

The role requires 6+ years in data engineering, strong Python/SQL skills, and hands-on AWS, Databricks, Snowflake experience.