GenAI-Powered Data Architect & Big Data Engineer

RISKDATA CONSULTING PTE. LTD.

Singapore

On-site

SGD 90,000 - 150,000

Full time

4 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

RISKDATA CONSULTING PTE. LTD. in Singapore seeks a Senior Data Engineer to design, build and optimize scalable data pipelines and platforms. You will work with Python, Spark, Kafka and cloud technologies to deliver enterprise-grade data solutions, focusing on performance, reliability and data quality.

Experience with AI/GenAI integration and CI/CD is highly desirable; join a team of data professionals delivering large-scale analytics.

Qualifications

Bachelor's or master's degree in computer science, Information Technology, Programming & Systems Analysis, Computer Studies or a related discipline.
Strong professional experience in Big Data, Cloud Computing or related technology domains.
Experience working with large-scale enterprise data platforms and production data pipelines.
Strong programming and SQL skills.
Experience with cloud-based data engineering and modern data processing frameworks.
Experience with AI/ML, NLP or Generative AI will be highly advantageous.

Responsibilities

Design, develop and maintain scalable ETL/ELT data pipelines for large datasets.
Develop high-performance data processing solutions using Python, PySpark, Spark SQL and Scala.
Build batch and real-time data pipelines using Kafka, Kinesis, Spark Streaming, AWS Glue and Airflow.
Develop data ingestion frameworks integrating RDBMS, APIs, files, cloud storage and streaming platforms.
Design and implement data lakes, data warehouses and cloud-based data processing platforms.
Work with Databricks, Hadoop, Hive, Cloudera, Presto and Snowflake for large-scale data processing.
Perform data modelling, data transformation, data quality, query optimisation and performance tuning.