Senior Data Engineer (GCP + AWS)

PALO IT SINGAPORE PTE. LTD.; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

A global technology consultancy is seeking a Senior Data Engineer in Singapore to design and implement scalable data pipelines using AWS and GCP. The ideal candidate has over 7 years of experience in data engineering, strong skills in Python and SQL, and familiarity with orchestration tools like Airflow. The role involves migrating workloads to cloud-native services and building reusable data frameworks.

Benefits

Stimulating working environments

Unique career path

International mobility

Knowledge sharing

Personalized training

Qualifications

• 7+ years in data engineering with end-to-end pipeline design and implementation.
• Experience with AWS services like S3, Glue, Lambda, and more.
• Experience with GCP services like BigQuery, Dataflow, and more.

Responsibilities

• Design and implement scalable ETL/ELT pipelines.
• Migrate existing workloads into cloud-native services.
• Build reusable data frameworks for data ingestion.

Skills

AWS expertise

GCP expertise

Strong Python development skills

Strong SQL development skills

Proficiency with orchestration tools

Shell scripting (Linux)

Familiarity with data formats

Tools

Airflow

Docker

Kubernetes

Job description

Who We Are

Build. Scale. Sustain.

PALO IT is a global technology consultancy that crafts tech as a force for good. We design, develop and scale digital and sustainable products and services to unlock value across the triple bottom line: people, planet, profit. We do the right thing, and we do it right. We’re proud to be a World Economic Forum New Champion, and a B Corp-certified company.

• We are small enough to care locally, big enough to deliver globally (5 continents, 18 offices, +650 experts from +50 nationalities)
• We are robust and resilient (100% independent and 0 debt)
• We are entrepreneurs and passionate experts: We invest in what we believe genuinely and work as a collective intelligence
• We are positive, courageous, caring, doers and committed to excellence

YOUR ROLE:

The projects involve building and scaling cloud-native data pipelines to handle ingestion, transformation, quality assurance, enrichment, and advanced analytics use cases across multiple industries. We are seeking a Senior Data Engineer to modernize and enhance data platforms, with strong expertise in AWS and GCP.

• Design and implement scalable ETL/ELT pipelines on AWS and GCP.
• Migrate existing on-premises and hybrid workloads into cloud-native services.
• Build reusable data frameworks for ingestion, quality monitoring, and transformations.
• Implement robust error handling, recovery mechanisms, and observability into pipelines.
• Partner with Data Scientists and Architects to enable predictive/GenAI use cases.

MUST HAVE EXPERIENCE

• 7+ years in data engineering with end-to-end pipeline design and implementation.
• AWS expertise: S3, Glue, Lambda, Step Functions, EMR, Athena, Fargate, AWS Batch.
• GCP expertise: BigQuery, Dataflow, Pub/Sub, Dataproc, Cloud Functions.
• Strong Python and SQL development skills.
• Proficiency with orchestration tools like Airflow or Cloud Composer.
• Shell scripting (Linux).
• Familiarity with data formats (Parquet, ORC, JSON, Avro) and modern storage patterns.

GOOD TO HAVE

• Experience integrating AWS ↔ GCP cross-cloud pipelines.
• Knowledge of containerization (Docker, Kubernetes, GKE/EKS).
• Domain knowledge in Financial Services, Healthcare, Maritime, or Retail.

We will be prioritizing applicants who have a current right to work in Singapore, and do not require sponsorship of a visa.

MORE ABOUT PALO IT:

We’re eager to adapt to change, learn from our experiences and move to meet our planet’s urgent needs. We are continuously taking action to:

• Become a climate net-zero company
• Attain 50% of revenue from projects with a positive impact
• Train 100% of our workforce on impact
• Achieve B Corp certification among all our offices across the globe
• Continuously measure & improve employee happiness

Our clients are amongst the world's most successful companies. We innovate with both established Fortune 1000s, SMEs and start-ups who aim to make an impact, become global leaders and address the world's most complex challenges.

What We Offer

• Stimulating working environments
• Unique career path
• International mobility
• Internal R&D projects
• Knowledge sharing
• Personalized training

For more on our team culture and benefits, check out our careers page.

PALO IT Singapore is an equal opportunity employer. Employment decisions will be based on merit, qualifications and abilities. Palo IT SG does not discriminate in employment opportunities or practices on the basis of race, colour, religion, sex, sexuality, national origin, age, disability, marital status or any other characteristics protected by law.

Protecting your privacy and the security of your data are longstanding top priorities for Palo-IT.

Your personal data will be processed for the purposes of managing Palo-IT’s recruitment related activities, which include setting up and conducting interviews and tests for applicants, evaluating and assessing the results, and as is otherwise needed in the recruitment and hiring processes.

Please consult our Privacy Notice to know more about how we collect, use, and transfer the personal data of our candidates. Here you can find how you can request for access, correction and/or withdrawal of your PersonalData.