Data Engineer

Collinson (Singapore)

Poland

On-site

PLN 180,000 - 240,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Collinson (Singapore) is seeking a Data Engineer to design and maintain data pipelines using Python, SQL, Snowflake and dbt. You will manage Snowflake objects, optimize performance, and ensure secure access across distributed teams.

You will work with Kafka for real-time data, deploy AWS resources with Terraform, and automate CI/CD with GitHub Actions. The role requires hands-on engineering, on-call readiness and strong collaboration across departments.

Qualifications

  • A university degree in computer science, engineering or a related discipline, or equivalent practical experience.
  • At least 4-5 years of hands‑on Data Engineering.
  • Strong Python and SQL skills, with experience writing production code.
  • Practical experience with Snowflake and confluent for data transformation.
  • Hands‑on experience with AWS and Terraform.
  • Understanding of Kafka, including topics, consumers and data streaming.
  • Experience with Git, CI/CD and automated testing.
  • Ability to troubleshoot data pipelines and production issues independently.
  • Understanding of cloud security, monitoring and access management.
  • Good communication, problem‑solving and teamwork skills.

Responsibilities

  • Build, maintain and troubleshoot data pipelines using Python and SQL.
  • Manage Snowflake objects, including tables, views and access permissions.
  • Work with Kafka topics, schemas and connectors for real-time data movement.
  • Use Terraform to deploy and maintain AWS resources and other cloud services.
  • Write Python scripts, create automated tests and manage CI/CD with GitHub Actions.
  • Monitor pipelines and production services, investigate failures and participate in on-call support.
  • Ensure security, access controls and platform reliability while managing costs.
  • Contribute to incident response, runbooks and post-incident actions across distributed teams.

Skills

Python
SQL
Data engineering
Problem-solving
Teamwork
Communication

Education

Bachelor's degree in CS/Engineering

Tools

Snowflake
dbt
Confluent Cloud (Kafka)
AWS
Terraform
MongoDB Atlas
SnapLogic
Datadog
PagerDuty
GitHub Actions
Docker/ECS/Fargate
JSON Schema
Policy-as-code (OPA/Conftest)

Job description

Job Description
  • Build Data Pipelines: Develop, maintain and troubleshoot data pipelines using Python, SQL, Snowflake and dbt.
  • Manage Snowflake: Create and maintain tables, views and access permissions, while improving performance.
  • Kafka & Streaming: Work with Kafka topics, schemas and connectors to manage real-time data movement.
  • Manage AWS Infrastructure: Use Terraform to deploy and maintain AWS resources and other cloud platform services.
  • Automate Processes: Write Python scripts, create automated tests and manage CI/CD deployments using GitHub Actions.
  • Fix Production Issues: Monitor pipelines and platform services, investigate failures, resolve incidents and participate in on-call support.
  • Maintain Security and Reliability: Follow security standards, manage access controls and improve platform stability and costs.
  • Participate in the on-call rota, diagnose production issues, coordinate incident response, and drive post-incident actions that prevent recurrence.
  • Maintain runbooks, architecture records and operational documentation for the services and workflows you own.
  • Contribute to agile planning, technical design and code reviews, and collaborate effectively with engineers and stakeholders across distributed teams.
Knowledge, skills and experience required

Our core platform stack includes Python and SQL; Snowflake and dbt; Confluent Cloud (Kafka, Schema Registry, Flink SQL and ksqlDB); AWS; Terraform; MongoDB Atlas; SnapLogic; Datadog and PagerDuty; GitHub Actions; Docker and ECS/Fargate; and JSON Schema data contracts with policy-as-code controls.

Required
  • A university degree in computer science, engineering or a related discipline, or equivalent practical experience.
  • At least 4-5 years of hands‑on Data Engineering.
  • Strong Python and SQL skills, with experience writing production code.
  • Practical experience with Snowflake and confluent for data transformation.
  • Hands‑on experience with AWS and Terraform.
  • Understanding of Kafka, including topics, consumers and data streaming.
  • Experience with Git, CI/CD and automated testing.
  • Ability to troubleshoot data pipelines and production issues independently.
  • Understanding of cloud security, monitoring and access management.
  • Good communication, problem‑solving and teamwork skills.
Nice to have
  • Stream processing with Flink SQL or ksqlDB; Java for Flink user‑defined functions is an advantage.
  • Administration or integration experience with MongoDB Atlas, SnapLogic or AWS DMS, including deployment, monitoring, migrations, backup and recovery.
  • Observability, incident response and delivery automation using Datadog, PagerDuty and GitHub Actions.
  • Docker, ECS/Fargate and AWS networking, including PrivateLink or Transit Gateway, with a focus on resilience, capacity and cost.
  • JSON Schema, data contracts and policy‑as‑code controls using OPA or Conftest.
  • AI‑assisted software development tools and practices that improve delivery speed and quality, supported by appropriate review, testing, security and governance controls.

We welcome applicants with diverse perspectives, career paths and equivalent experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Collinson Group • Poland

On-site
PLN 180,000 - 240,000
Senior Snowflake Data Engineer
Senior Snowflake Data Engineer

Luxoft • Polska

On-site
PLN 180,000 - 240,000
DataOps Engineer
DataOps Engineer

AgileEngine, LLC. • Kraków, Warszawa, Lublin, Szczecin

Hybrid
PLN 180,000 - 260,000
Professional growth
USD-based compensation
Exciting projects
+1
Snowflake Data Engineer: ETL/ELT & Cloud Pipelines
Snowflake Data Engineer: ETL/ELT & Cloud Pipelines

Dhan AI Inc. • Polska

Hybrid
PLN 150,000 - 230,000
Data Engineer
Data Engineer

CodiLime • Kraków, Wrocław, Poznań

Hybrid
PLN 180,000 - 240,000
Flexible working hours
Training budget
Data Engineer (Data Engineering Team)
Data Engineer (Data Engineering Team)

Unchain Data • Warszawa

Hybrid
PLN 180,000 - 240,000
Data Engineer
Data Engineer

Luxoft • Polska

On-site
PLN 180,000 - 280,000
Laptop and monitor
Snowflake Data Engineer (Airflow)
Snowflake Data Engineer (Airflow)

Link Group • Województwo mazowieckie

On-site
PLN 150,000 - 190,000
Snowflake Engineer
Snowflake Engineer

Dhan AI Inc. • Polska

On-site
PLN 150,000 - 230,000
Data Engineer
Data Engineer

Avanade Inc. • Kraków

On-site
PLN 90,000 - 130,000
Top locations