Senior Data Engineer - AWS, Data Lake & Pipelines

PALO IT SINGAPORE PTE. LTD.; Remote; GBP 60,000 - 80,000; Full time

Job summary

A global technology consultancy is looking for a Senior Data Engineer to enhance data pipelines and manage large data sets. The ideal candidate has extensive experience in data engineering and big data frameworks, with a strong proficiency in Python, SQL, and AWS tools. You will collaborate closely with interdisciplinary teams to deliver impactful data solutions. This role requires a minimum of 7 years in the field and offers a dynamic environment committed to technology and sustainability.

Benefits

Stimulating working environments

Unique career path

International mobility

Internal R&D projects

Personalized training

Qualifications

• At least 7 years of experience in data engineering.
• Good understanding of big data technology landscape.
• Experience with batch & ETL jobs.

Responsibilities

• Execute and enhance data pipeline with error handling and monitoring.
• Migrate pipeline to AWS Cloud using managed components.
• Collaborate with teams to enable intelligence across digital mesh.

Skills

Data pipeline execution

Python proficiency

SQL knowledge

Shell scripting (Linux)

AWS tools proficiency (S3, Glue, etc.)

Experience with Airflow

NoSQL database experience

Education

Bachelor's/Master's/Ph.D. in IT, Information Management, or Computer Science

Tools

Hadoop

Spark

Power BI

Job description

A global technology consultancy is looking for a Senior Data Engineer to enhance data pipelines and manage large data sets. The ideal candidate has extensive experience in data engineering and big data frameworks, with a strong proficiency in Python, SQL, and AWS tools. You will collaborate closely with interdisciplinary teams to deliver impactful data solutions. This role requires a minimum of 7 years in the field and offers a dynamic environment committed to technology and sustainability.