Data Lead – Data Engineering

Aryan-Solutions-Pte.-Ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Aryan-Solutions-Pte.-Ltd. in Singapore is seeking a Data Lead - Data Engineering to oversee enterprise data platforms supporting large-scale ETL and batch processing.

You will drive diagnostics, optimisation and stabilisation of data pipelines, collaborating with data engineers, architects and business teams to ensure production readiness and reliability. The role involves hands-on work with ADF, Databricks, SSIS and SQL Server, plus batch orchestration tools, monitoring, and performance tuning

Qualifications

• Extensive experience in building and optimising ETL/ELT pipelines.
• Strong SQL development and performance-tuning skills.
• Hands-on with batch orchestration tools (Control-M/Autosys).
• Experience with cloud data platforms and monitoring (Azure Monitor).
• Familiarity with large-scale data processing and data quality practices.

Responsibilities

• Drive diagnostics, optimisation and stabilisation of enterprise data platforms.
• Review and optimise ADF pipelines, SSIS packages and Databricks workflows.
• Analyse batch scheduling, dependencies, triggers and SLA adherence.
• Investigate and resolve pipeline failures and runtime issues for faster recovery.
• Collaborate with data engineers, architects and business teams to ensure production stability.

Skills

ADF

Databricks

SSIS

SQL Server

Control-M

Autosys

SQL development

Performance tuning

Monitoring

PySpark

Spark SQL

Tools

Azure Data Factory

Databricks

Job description

Experience:7-12 Years
Location:Singapore

Fulltime Permanent Role

We are looking for a Data Lead - Data Engineeringto drive technical diagnostics, optimisation, and stabilisation of enterprise data platforms supporting large-scale ETL and batch processing systems.

Key Responsibilities

• Strong expertise in: Azure Data Factory (ADF),Databricks (PySpark / Spark SQL preferred),SSIS and SQL Server
• Hands-on experience with: Batch orchestration tools (Control-M / Autosys),ETL/ELT pipeline design and optimization
• Strong experience in: SQL development and performance tuning, Troubleshooting and debugging complex data pipelines
• Familiarity with: Monitoring and alerting tools (Azure Monitor, Log Analytics)
• Exposure to large-scale data processing and batch system
• Review and optimize ADF pipelines, SSIS packages, and Databricks workflowsfor performance, scalability, and
• Analyze batch scheduling and orchestration frameworks(Control-M / Autosys), including dependencies, triggers, and SLA adherence
• Investigate and resolve pipeline failures, job delays, and runtime issues, ensuring faster recovery and minimal business
• Evaluate source-to-target integration flows, SQL logic, and transformation layersfor efficiency and correctness
• Define and improve error handling, retry mechanisms, restart ability, and reprocessing strategiesacross ETL and batch
• Optimize runtime performance of data pipelines, including query tuning and batch execution improvements
• Establish and enhance monitoring and alerting frameworksusing tools like Azure Monitor, Control-M dashboards, and custom logging solutions
• Identify automation opportunitiesto reduce manual intervention and improve operational efficiency
• Ensure data quality, consistency, and reliabilityacross ETL processes and reporting outputs
• Support modernization initiatives, including migration from legacy ETL (SSIS) to cloud-based platforms like Databricks
• Collaborate with data engineers, architects, business, and support teamsto drive improvements and ensure stable production systems