Data Ingestion Operations Engineer Unix, Linux, SQL, Git, Jenkins Warszawa, Łódź, Gdańsk, Gdynia

Diverse Consulting Group; Polska; Hybrid; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Dedicated consultant support

Job summary

Diverse Consulting Group is seeking a Data Ingestion Operations Engineer to support data ingestion configurations and production data sources. You will prepare and test configurations, ingest data sources into Hadoop, and maintain ingested data in production.

The role requires hands-on Unix/Linux, SQL, Git and Jenkins, with strong problem-solving and English communication. You will work in an Agile environment and contribute to resilient ingestion pipelines using ARC Ingestion Framework.

Qualifications

• Hands-on Unix/Linux experience.
• Solid knowledge of SQL.
• Experience with Git and Jenkins.
• Ability to troubleshoot technical issues and work in an Agile environment.

Responsibilities

• Prepare and test configurations for data ingestion using ARC Ingestion Framework
• Ingest data sources into Hadoop
• Maintain data sources already ingested in production
• Troubleshoot issues related to ingestion processes and configurations
• Work in an Agile environment

Skills

Unix/Linux

SQL

Git

Jenkins

Troubleshooting

Agile

English

Tools

ARC Ingestion Framework

Hadoop

Robot Framework

Jira

Confluence

Helix

Python basics

Job description

Position: Data Ingestion Operations Engineer

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Data Ingestion Operations Engineer

Responsibilities:

• Prepare and test configurations for data ingestion using ARC Ingestion Framework
• Ingest data sources into Hadoop
• Maintain data sources already ingested in production
• Troubleshoot issues related to ingestion processes and configurations
• Work in an Agile environment

Requirements:

• Hands-on experience with Unix / Linux
• Practical knowledge of SQL
• Experience with Git
• Familiarity with Jenkins
• Ability to troubleshoot technical issues
• Strong rational thinking and problem-solving skills
• Experience working in an Agile environment
• Experience working with different applications and configurations
• Very good command of English, both spoken and written

Nice to have:

• Experience with testing
• Familiarity with Hadoop
• Experience with Robot Framework
• Knowledge of Jira, Confluence, or Helix
• Basic Python knowledge

Offer:

• Private medical care
• Co-financing for the sports card
• Constant support of dedicated consultant

Personal Consulting Agency (License No. 4642)