data BAU lead - data engineering (weekends, shift) #IKR

RECRUIT EXPRESS PTE LTD; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

RECRUIT EXPRESS PTE LTD is seeking an experienced Data BAU Lead to drive data engineering operations, production support, and continuous improvement in a cloud-first environment in Singapore.

You will lead a team of Data Engineers, design scalable pipelines, and migrate legacy workloads to Snowflake and AWS. Collaboration with business stakeholders and DevOps is essential for delivering robust data solutions.

Qualifications

• 7+ years in Data Engineering, including 2+ years in Lead/Production Support roles.
• Good knowledge of AWS services and data warehousing principles.
• Hands-on with SQL, Python, PySpark, Spark, and Unix Shell.
• Experience with ETL, data ingestion and large-scale datasets.
• Understanding of CI/CD, Git, and Agile/SDLC.

Responsibilities

• Lead a team of Data Engineers for BAU operations, production support, incidents, and platform stability.
• Design and support scalable data pipelines, feeds, data lakes and warehouses.
• Migrate legacy workloads to Snowflake, Spark and AWS Glue.
• Collaborate with business, architects, DS and DevOps to deliver data solutions.
• Improve data quality, performance, monitoring and automation.
• Support data strategy, architecture, security and governance.

Skills

AWS

Snowflake

SQL

Python

PySpark

Spark

Unix Shell

CI/CD

Git

Agile/SDLC

Data pipelines

Team leadership

Education

Bachelor’s degree in CS/Engineering

Tools

Snowflake

AWS Glue

DMS

MWAA/Airflow

IAM

Lambda

RDS

Kinesis

Step Functions

Job description

Note: Successful candidates need to be comfortable with working on weekends and shift as and when required

We are looking for an experienced Data BAU Lead to lead data engineering operations, production support, and continuous improvement in a cloud-first environment.

Key Responsibilities

• Lead a team of Data Engineers managing BAU operations, production support, incidents, and platform stability.
• Design, develop and support scalable data pipelines, data feeds, data lakes and data warehouses.
• Drive migration of legacy Oracle, MS-SQL, Hive and Impala workloads to Snowflake, Spark and AWS Glue.
• Work closely with business, architects, Data Scientists and DevOps teams to deliver data solutions.
• Improve data quality, performance, monitoring, automation and operational efficiency.
• Support data strategy, architecture, security and governance initiatives.
• Any other ad-hoc duties as assigned by the supervisor

Key Skills & Experience

• Good to have more than 7 years of Data Engineering experience, including 2+ years in hands-on Lead/Production Support roles.
• Strong expertise in AWS – S3, Glue, DMS, MWAA/Airflow, IAM, Lambda, RDS, Kinesis and Step Functions.
• Strong Snowflake expertise and data warehouse/data lake experience.
• Hands-on programming skills in SQL, Python, PySpark, Spark and Unix Shell.
• Experience with ETL, data ingestion, data integration, distributed systems and large-scale datasets.
• Strong understanding of CI/CD, Git, Agile/SDLC and cloud optimization.
• Proven experience in team leadership, stakeholder management and production/BAU environments.
• Bachelor’s degree in computer science, Engineering, STEM or related field