IngestOps Engineer

Optiveum; Warszawa; Hybrid; PLN 99,000 - 165,000; Full time

Job summary

Optiveum is recruiting an IngestOps Engineer to join a global banking client. You will ingest data onto Hadoop using the ARC Ingestion Framework, prepare and test configurations for new data sources, and maintain sources already running in production.

You will work in an Agile team with data, application and infrastructure stakeholders, troubleshoot ingestion issues across different applications and configurations, and collaborate closely with the rest of the team.

Qualifications

• Hands-on experience with Unix/Linux.
• Good knowledge of SQL.
• Experience with Git and Jenkins.
• Experience working with different applications and their configurations.
• Strong troubleshooting skills and analytical, rational thinking.
• Experience working in an Agile environment.
• Fluent English.

Responsibilities

• Ingesting data onto Hadoop using the ARC Ingestion Framework.
• Preparing and testing configurations for new ingestion sources.
• Maintaining and supporting sources already ingested in production.
• Troubleshooting ingestion issues across different applications and configurations.
• Working in an Agile team with data, application and infrastructure stakeholders.

Skills

Unix/Linux

SQL

Git

Jenkins

Agile

English

Tools

ARC Ingestion Framework

Robot Framework

Python

Hadoop

Jira

Confluence

Helix

Job description

IngestOps Engineer

About the Offer

We are currently looking for an IngestOps Engineer to join the team of our global client from the banking industry. You will be responsible for ingesting data onto Hadoop using the ARC Ingestion Framework: preparing and testing configurations for new data sources and maintaining sources already running in production. For this role, Optiveum is the recruitment and contracting party, which means you will sign the cooperation agreement directly with us.

Key Details:

• Rate: up to 120 PLN/h net (B2B)

• Work Model: hybrid, 1 day per week from the office, full-time (40 h/week)

• Location: Warsaw, Łódź or Tricity (Gdańsk/Gdynia)

Responsibilities:

• Ingesting data onto Hadoop using the ARC Ingestion Framework

• Preparing and testing configurations for new ingestion sources

• Maintaining and supporting sources already ingested in production

• Troubleshooting ingestion issues across different applications and configurations

• Working in an Agile team with data, application and infrastructure stakeholders

Requirements:

• Hands-on experience with Unix/Linux

• Good knowledge of SQL

• Experience with Git and Jenkins

• Experience working with different applications and their configurations

• Strong troubleshooting skills and analytical, rational thinking

• Experience working in an Agile environment

• Fluent English

Nice to have:

• Experience with Hadoop or other big data platforms

• Experience with the ARC Ingestion Framework or other data ingestion tools

• Testing experience, including Robot Framework

• Basic Python knowledge

• Familiarity with Jira, Confluence and Helix