Data Engineer (AWS cloud)

Idego Group; Gdynia; Remote; PLN 180,000 - 240,000; Full time

Job summary

An international e-commerce solutions provider is seeking a Data Engineer to join their expanding team in Gdynia. The role offers autonomy in a collaborative environment while working on cloud-based technologies, including AWS services. Responsibilities include building a Data Lake, maintaining data warehouses, and constructing ETL pipelines. The position allows for 100% remote work and includes various benefits such as private medical insurance and wellness programs.

Benefits

100% remote work

Private medical insurance

Multisport benefits

Free seaside apartment for leisure and work

Qualifications

• Experience with both cloud-based data storage and processing.
• Knowledge of data migration and streaming techniques.
• Ability to work autonomously in a team-oriented environment.

Responsibilities

• Build and maintain a Data Lake on AWS processing large datasets.
• Construct ETL pipelines to streamline data processing.
• Standardize and clean data from diverse sources for reporting.

Skills

Data Engineering

AWS services (S3, EMR, Glue)

ETL processes (Airflow, Python, Spark)

Tools

AWS Redshift

Apache Hudi

Delta Lake

Job description

We provide quality and give ourselves a lot of autonomy, common sense, and general friendliness.

Project specifics

Our client, an international provider of e-commerce solutions, is expanding the Data Engineering team, and we’re helping!

There’s a lot to be done within a pretty nice stack: everything is in the cloud, and there are NO on-premises solutions.
Main challenges include: migration to a new cloud-based data warehouse and wider implementation of data streaming.
You’ll join two experienced Data Engineers and cooperate with Europe-based Data Science teams.

• Data Lake (AWS S3, EMR, Glue, Athena, Kinesis, Apache Hudi, Delta Lake)
• Data Warehouse (AWS Redshift)
• ETL (Airflow, Python, Spark)

What we do:

• Building the Data Lake in AWS, processing over 500M records daily
• Maintaining Data Warehouse (AWS Redshift)
• Constructing ETL data pipelines in Airflow, Python, and Spark
• Standardizing and cleaning data from various sources (SQL, NoSQL DBs, APIs, queues) for internal reporting
• Architecting scalable Data Streaming as our next big milestone

Do you want to see if Idego is a perfect match for you?

• Work environment with zero micromanagement – we cherish autonomy.
• 100% remote work (unless you prefer to work from our HQ in Gdynia), including recruitment & onboarding.
• A really cool seaside apartment available for free for both leisure and work.
• Experienced team with members from 8 to over 15 years in commercial projects.
• Private medical insurance and Multisport benefits.

Join Us

CV

I hereby agree that Idego Group Sp. z o.o., with its registered office in Gdynia, Al. Zwycięstwa 96/98, may process my personal data contained in the submitted application documents for recruitment and future opportunities. I understand that I can withdraw my consent at any time.