Data Engineer/ ETL Developer

emagine; Gdynia; Hybrid; PLN 114,000 - 162,000; Full time

Job summary

emagine is seeking an experienced OPS Developer to ingest data onto Hadoop using the ARC Ingestion Framework. The role emphasizes hands-on Linux, SQL, Git, and configuration management in an agile environment.

Key responsibilities include preparing ingestion configurations, maintaining sources in production, and collaborating with the team to ensure seamless operations. Strong troubleshooting skills and knowledge of data ingestion pipelines are essential.

Qualifications

• Proficient Unix/Linux skills with troubleshooting mindset.
• Strong SQL knowledge and data handling abilities.
• Experience with Git version control and CI/CD workflows.
• Familiarity with Jenkins and build pipelines.
• Comfort with agile methodologies and fast-paced environments.

Responsibilities

• Prepare and test configurations for data ingestion sources.
• Maintain ingested data sources in production.
• Collaborate with the team to ensure smooth operations.
• Monitor and troubleshoot data ingestion issues.
• Document ingestion processes and configurations.

Skills

Unix/Linux

SQL

Git

Jenkins

Troubleshooting

Agile

Tools

Hadoop

Robot Framework

Jira

Confluence

Helix

Python

Job description

General info:

Model of work: hybrid (3x per week work from office: Gdynia/ Gdańsk/ Warsaw or Łódź)

Type of contract: B2B contract, long - term cooperations

Rate: up to 100 PLN net + vat/ hour

Introduction & Summary

We are seeking an experienced OPS Developer to assume responsibility for ingesting data onto Hadoop utilizing the ARC Ingestion Framework. The ideal candidate will have a strong background in an agile environment, with hands‑on experience working in Linux, SQL, Git, and dealing with various applications and configurations.

Main Responsibilities

• Prepare and test configurations for data ingestion sources.
• Maintain existing data sources already ingested in production.
• Collaborate with team members to ensure seamless operations.
• Monitor and troubleshoot issues related to data ingestion.
• Document processes and configurations for ingestion tasks.

Key Requirements

• Unix / Linux expertise.
• Proficient in SQL.
• Experience with Git.
• Familiarity with Jenkins.
• Strong rational thinking and troubleshooting skills.

Nice to Have

• Testing experience.
• Familiarity with Hadoop.
• Knowledge of Robot Framework.
• Experience with Jira, Confluence, and Helix.
• Basic knowledge of Python.