Senior AI Data Engineer: Scalable Pipelines Lead

aryan solutions pte. ltd.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

aryan solutions pte. ltd. is seeking a data engineer to design, build, and operate production-grade data pipelines in a cloud-scale environment. You will own end-to-end data workflows, from ingestion to transformation and validation, across batch and streaming jobs.

You will collaborate with engineers, architects, and product owners to translate requirements into secure, scalable platform solutions, and you will document architectures while contributing to data governance and release processes.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• 5–8 years of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery, with ownership of production pipelines.
• Proven ability to independently design, build, optimise, and operate production-grade batch or streaming data pipelines, including orchestration, observability, error handling, performance tuning, and operational support.
• Hands-on experience with Python and SQL for data transformation and validation
• Familiarity with Apache Spark (PySpark) and large-scale data processing concepts
• Experience with implementing knowledge base and RAG solutions for agentic AI use cases
• Self-starter with strong problem-solving skills and attention to detail
• Able to work independently and lead technical discussions with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure and maintainable platform solutions.
• Strong documentation and communication skills
• Strong understanding of enterprise data architecture, cloud security, access control, CI/CD, release management, and production operations for data and AI platform solutions.

Responsibilities

• Lead technical discussions with engineers, architects, product owners, source-system teams, and business stakeholders to translate requirements into secure, maintainable platform solutions.
• Own and design end-to-end data pipelines and platform components for production, including orchestration, observability, and operational support.
• Collaborate with cross-functional teams to ensure scalable data architecture and robust CI/CD practices.

Skills

Data engineering

Production pipelines

Cloud-scale analytics

Python

SQL

PySpark

Apache Spark

System design

Education

Bachelor’s degree in Computer Science, Engineering, or a related field

Tools

Apache Spark

PySpark

Job description

aryan solutions pte. ltd. is seeking a data engineer to design, build, and operate production-grade data pipelines in a cloud-scale environment. You will own end-to-end data workflows, from ingestion to transformation and validation, across batch and streaming jobs.

You will collaborate with engineers, architects, and product owners to translate requirements into secure, scalable platform solutions, and you will document architectures while contributing to data governance and release processes.