Data Ingestion Engineer: Hadoop, Linux, SQL

Diverse CG Sp. z o.o. Sp.k.; Warszawa, Łódź, Gdynia; On-site; PLN 133,920 - 223,200; Full time

Benefits offered by this job

Private medical care

Co‑financing for the sports card

Constant support of dedicated consultant

Job summary

Diverse CG Sp. z o.o. Sp.k. located in Łódź, Poland is seeking a Data Operations Engineer to manage and support data ingestion processes using the ARC Ingestion Framework. Applicants should have strong analytical skills, experience in Unix/Linux environments, and proficiency in SQL. Excellent English communication skills are required. The role offers private medical care and support from a dedicated consultant.

Qualifications

• Experience working with Unix / Linux environments.
• Good knowledge of SQL.
• Experience using Git.
• Strong analytical and rational thinking skills.
• Experience working in an Agile setup.
• Very good command of English, both spoken and written.

Responsibilities

• Ingest data into Hadoop using the ARC Ingestion Framework.
• Prepare, configure, and test data ingestion setups for new data sources.
• Maintain and support data sources already running in production.
• Work with different applications and configurations related to data ingestion.
• Troubleshoot ingestion issues and operational problems.
• Collaborate within an Agile environment.
• Ensure stable and reliable ingestion operations through systematic problem-solving.

Skills

Unix / Linux environments

SQL

Git

Analytical skills

Agile environment

English (spoken and written)

Tools

Hadoop

Jenkins

Robot Framework

Jira

Confluence

Helix

Python

Job description

Diverse CG Sp. z o.o. Sp.k. located in Łódź, Poland is seeking a Data Operations Engineer to manage and support data ingestion processes using the ARC Ingestion Framework. Applicants should have strong analytical skills, experience in Unix/Linux environments, and proficiency in SQL. Excellent English communication skills are required. The role offers private medical care and support from a dedicated consultant.