Data Ingestion Engineer - Unix/Linux, SQL, Jenkins, Hadoop

Diverse Consulting Group; Polska; Hybrid; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Dedicated consultant support

Job summary

Diverse Consulting Group is seeking a Data Ingestion Operations Engineer to support data ingestion configurations and production data sources. You will prepare and test configurations, ingest data sources into Hadoop, and maintain ingested data in production.

The role requires hands-on Unix/Linux, SQL, Git and Jenkins, with strong problem-solving and English communication. You will work in an Agile environment and contribute to resilient ingestion pipelines using ARC Ingestion Framework.

Qualifications

• Hands-on Unix/Linux experience.
• Solid knowledge of SQL.
• Experience with Git and Jenkins.
• Ability to troubleshoot technical issues and work in an Agile environment.

Responsibilities

• Prepare and test configurations for data ingestion using ARC Ingestion Framework
• Ingest data sources into Hadoop
• Maintain data sources already ingested in production
• Troubleshoot issues related to ingestion processes and configurations
• Work in an Agile environment

Skills

Unix/Linux

SQL

Git

Jenkins

Troubleshooting

Agile

English

Tools

ARC Ingestion Framework

Hadoop

Robot Framework

Jira

Confluence

Helix

Python basics

Job description

Diverse Consulting Group is seeking a Data Ingestion Operations Engineer to support data ingestion configurations and production data sources. You will prepare and test configurations, ingest data sources into Hadoop, and maintain ingested data in production.

The role requires hands-on Unix/Linux, SQL, Git and Jenkins, with strong problem-solving and English communication. You will work in an Agile environment and contribute to resilient ingestion pipelines using ARC Ingestion Framework.