Data Engineering Architect Lead — AI-Driven Platform

OX CONSULTANCY PTE. LTD.; Singapore; Sur place; SGD 180 000 - 240 000; Plein temps

Résumé du poste

OX Consultancy is seeking an Architect Lead – Data Engineering to design and implement enterprise-scale data platforms and pipelines in a cloud-first environment. You will lead architecture, mentor teams and collaborate with stakeholders to translate requirements into scalable data solutions.

The role requires hands-on expertise with Spark, Snowflake, Airflow, Kafka and DBT, plus strong leadership and communication skills to drive data modernization across the organization.

Qualifications

• Minimum 10 years of experience in data engineering, big data or data architecture.
• Hands-on with Spark, PySpark, Snowflake, Airflow, Kafka and Iceberg.
• Experience with DBT and ETL/ELT frameworks.
• Experience with cloud-based data platforms and modern data architecture.
• Experience designing large-scale data pipelines and lakehouse architectures.
• Exposure to AI / AI-based data solutions.
• Strong analytical, problem-solving, communication and technical leadership skills.
• Degree in Computer Science, IT, Engineering or related discipline.

Responsabilités

• Lead architecture and design of scalable data engineering and data platform solutions.
• Design and develop high-volume data pipelines using Spark and PySpark.
• Implement data warehousing and analytics with Snowflake.
• Design workflow orchestration using Airflow.
• Develop data lake/lakehouse solutions using Iceberg.
• Design real-time and event-driven data pipelines using Kafka.
• Develop ETL/ELT solutions using DBT and enterprise ETL frameworks.
• Work with data platforms and ensure integration across enterprise data environments.
• Leverage cloud computing technologies to build secure, scalable and highly available data solutions.
• Provide technical leadership and mentoring to data engineering teams.
• Drive performance tuning, data quality, scalability and reliability of data platforms.
• Collaborate with business and technology stakeholders to translate requirements into technical solutions.
• Explore and implement appropriate AI capabilities within data platforms.

Connaissances

Spark

PySpark

Snowflake

Airflow

Kafka

Iceberg

DBT

ETL/ELT

Cloud platforms

AI capabilities

Formation

Bachelor's degree in CS/IT/Engineering

Description du poste

OX Consultancy is seeking an Architect Lead – Data Engineering to design and implement enterprise-scale data platforms and pipelines in a cloud-first environment. You will lead architecture, mentor teams and collaborate with stakeholders to translate requirements into scalable data solutions.

The role requires hands-on expertise with Spark, Snowflake, Airflow, Kafka and DBT, plus strong leadership and communication skills to drive data modernization across the organization.