Consigue una respuesta de este empleador
Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.
Talentsis pte. ltd. in Singapore seeks an experienced Senior Data Engineer to design, develop and maintain large-scale aviation data systems, building batch and real-time pipelines.
You will integrate multiple data sources, storage and recovery mechanisms, deploy on Kubernetes, and ensure data quality and governance across sites.
The role emphasizes GitLab CI/CD, monitoring, and disaster recovery with a focus on reliability and scalability.
We are seeking an experienced Senior Data Engineer to design, develop and maintain large-scale data processing solutions for aviation systems. You will build reliable batch and real-time data pipelines, integrate multiple data sources and implement scalable data storage, processing and recovery mechanisms.
Design, develop and maintain batch and real-time data pipelines using Apache Spark, Apache Flink and Apache Kafka.
Implement distributed data processing solutions using Java or Scala and SQL.
Integrate multiple data sources and S3-compatible object storage for data ingestion and processing.
Manage data schemas, metadata, lineage and data quality across processing pipelines.
Deploy, maintain and scale data processing workloads in Kubernetes environments.
Implement automated testing, GitLab CI/CD pipelines, monitoring and operational troubleshooting.
Establish checkpointing, recovery, data retention and lifecycle management mechanisms.
Support high availability, backup, disaster recovery and data synchronisation across multiple sites.
5–8 years of relevant experience in data engineering, distributed systems or large-scale data platform development.
Strong hands-on experience designing and developing batch and streaming data pipelines using Apache Spark, Apache Flink and Apache Kafka.
Proficiency in Java or Scala for distributed data processing, together with strong SQL skills.
Experience deploying and scaling data workloads using Docker and Kubernetes.
Familiarity with S3-compatible object storage, data schemas, metadata management, data lineage and data quality controls.
Experience with checkpointing, fault recovery, data retention and disaster recovery mechanisms.
Hands-on experience with GitLab, CI/CD pipelines, automated testing and monitoring.
Strong analytical, troubleshooting and problem-solving skills.
Only shortlisted candidates will be notified.
(EA Reg No: 20C0312)