Cloud-Native Python Backend Engineer | Data & ETL

Allegis Group Singapore Pte Ltd; Singapore; On-site; SGD 120,000 - 190,000; Full time

Job summary

Allegis Group Singapore Pte Ltd is seeking an experienced Python developer to contribute to cloud-native backend systems, focusing on backend development, performance optimization and scalable data processing.

Responsibilities include migrating legacy systems to cloud, building data pipelines with Spark and Airflow, and implementing automated testing and CI/CD. Candidates should have 8+ years in Python, AWS experience, and strong SQL skills.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Minimum 8 years of Python development experience, with a focus on backend and data engineering.
• Proven experience with cloud platforms (preferably AWS).
• Strong understanding of data engineering concepts, including ETL, data integration, and distributed processing.
• Hands-on experience with Airflow, Apache Spark or similar orchestration tools.
• Solid knowledge of SQL, database design, and performance tuning.
• Experience with automated testing frameworks and integration testing.
• Familiarity with .NET is advantageous.
• Proficiency in version control (Git), CI/CD tools, and Agile development practices.

Responsibilities

• Lead the migration of legacy systems to cloud-based environments.
• Design, build, and maintain scalable data integration and processing pipelines.
• Implement automated and integrated testing frameworks to ensure code quality and reliability.
• Optimize performance for large-scale data sets, including tuning for speed and efficiency.
• Collaborate with cross-functional teams to define technical requirements and deliver robust solutions.
• Apply strong database design and optimization techniques to support high-performance data operations.
• Work with cloud services (e.g., AWS) and/or Spark/Airflow for orchestration and distributed processing.
• Contribute to the evolution of the data engineering platform, ensuring alignment with best practices and business needs.
• Utilize Git, CI/CD pipelines (e.g., Jenkins, GitLab CI), and Agile methodologies (Scrum/Kanban).

Skills

Python

Backend development

Data engineering

AWS

SQL

ETL

Testing frameworks

Git

Agile

Spark

Airflow

Education

Bachelor's degree in Computer Science/Information Technology or related field

Tools

Apache Spark

Airflow

Jenkins

GitLab CI

CI/CD

Job description

Allegis Group Singapore Pte Ltd is seeking an experienced Python developer to contribute to cloud-native backend systems, focusing on backend development, performance optimization and scalable data processing.

Responsibilities include migrating legacy systems to cloud, building data pipelines with Spark and Airflow, and implementing automated testing and CI/CD. Candidates should have 8+ years in Python, AWS experience, and strong SQL skills.