Data Ingestion Engineer – Hybrid (Linux, SQL & Hadoop)

emagine; Gdynia; Hybrid; PLN 114,000 - 162,000; Full time

Job summary

emagine is seeking an experienced OPS Developer to ingest data onto Hadoop using the ARC Ingestion Framework. The role emphasizes hands-on Linux, SQL, Git, and configuration management in an agile environment.

Key responsibilities include preparing ingestion configurations, maintaining sources in production, and collaborating with the team to ensure seamless operations. Strong troubleshooting skills and knowledge of data ingestion pipelines are essential.

Qualifications

• Proficient Unix/Linux skills with troubleshooting mindset.
• Strong SQL knowledge and data handling abilities.
• Experience with Git version control and CI/CD workflows.
• Familiarity with Jenkins and build pipelines.
• Comfort with agile methodologies and fast-paced environments.

Responsibilities

• Prepare and test configurations for data ingestion sources.
• Maintain ingested data sources in production.
• Collaborate with the team to ensure smooth operations.
• Monitor and troubleshoot data ingestion issues.
• Document ingestion processes and configurations.

Skills

Unix/Linux

SQL

Git

Jenkins

Troubleshooting

Agile

Tools

Hadoop

Robot Framework

Jira

Confluence

Helix

Python

Job description

emagine is seeking an experienced OPS Developer to ingest data onto Hadoop using the ARC Ingestion Framework. The role emphasizes hands-on Linux, SQL, Git, and configuration management in an agile environment.

Key responsibilities include preparing ingestion configurations, maintaining sources in production, and collaborating with the team to ensure seamless operations. Strong troubleshooting skills and knowledge of data ingestion pipelines are essential.