IngestOps Engineer

ITConnect Sp. z o.o.; Polska; Hybrid; PLN 120,000 - 180,000; Full time

Job summary

ITConnect is seeking a data ingestion specialist to manage data flows into Hadoop using ARC Ingestion Framework. The role includes configuring ingestion sources, testing setups, and maintaining production pipelines.

You will work in an Agile team, applying SQL, Git, and Jenkins to troubleshoot and optimize data processes. The ideal candidate combines rational problem solving with hands-on experience across various applications and configurations, ensuring reliability of ingestion pipelines in

Qualifications

• Experience ingesting data on Hadoop using ARC Ingestion Framework.
• Prepare and test configurations for ingesting sources and maintain production sources.
• Experience working in an Agile environment.
• Proficient in SQL, Git, Jenkins; strong troubleshooting and rational thinking.

Responsibilities

• Ingest data onto Hadoop using ARC Ingestion Framework.
• Prepare and test configurations for ingesting sources and maintain production sources.
• Collaborate in an Agile environment and work with different applications and configurations.

Skills

Analytical thinking

Troubleshooting

Agile

Tools

ARC Ingestion Framework

Hadoop

Git

Jenkins

Job description

The assignment involves ingesting data onto Hadoop using the ARC Ingestion Framework, including preparation, testing, and maintenance of source configurations in production.

• Ingesting data onto Hadoop using ARC Ingestion Framework.
• Preparing and testing configuration for ingesting sources and maintaining sources already ingested on production.
• Experience working in an Agile environment
• SQL
• Git
• Jenkins
• Rational thinking
• Troubleshooting
• Experience working with different applications and configurations