Hybrid Data Ingest Engineer - Hadoop/ARC Framework

Optiveum; Warszawa; Hybrid; PLN 99,000 - 165,000; Full time

Job summary

Optiveum is recruiting an IngestOps Engineer to join a global banking client. You will ingest data onto Hadoop using the ARC Ingestion Framework, prepare and test configurations for new data sources, and maintain sources already running in production.

You will work in an Agile team with data, application and infrastructure stakeholders, troubleshoot ingestion issues across different applications and configurations, and collaborate closely with the rest of the team.

Qualifications

• Hands-on experience with Unix/Linux.
• Good knowledge of SQL.
• Experience with Git and Jenkins.
• Experience working with different applications and their configurations.
• Strong troubleshooting skills and analytical, rational thinking.
• Experience working in an Agile environment.
• Fluent English.

Responsibilities

• Ingesting data onto Hadoop using the ARC Ingestion Framework.
• Preparing and testing configurations for new ingestion sources.
• Maintaining and supporting sources already ingested in production.
• Troubleshooting ingestion issues across different applications and configurations.
• Working in an Agile team with data, application and infrastructure stakeholders.

Skills

Unix/Linux

SQL

Git

Jenkins

Agile

English

Tools

ARC Ingestion Framework

Robot Framework

Python

Hadoop

Jira

Confluence

Helix

Job description

Optiveum is recruiting an IngestOps Engineer to join a global banking client. You will ingest data onto Hadoop using the ARC Ingestion Framework, prepare and test configurations for new data sources, and maintain sources already running in production.

You will work in an Agile team with data, application and infrastructure stakeholders, troubleshoot ingestion issues across different applications and configurations, and collaborate closely with the rest of the team.