Data Ingestion Operations Engineer

DCG; Województwo mazowieckie; On-site; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Private medical care

Co-financing for the sports card

Constant support of dedicated consult·

Job summary

DCG in Poland is seeking a Data Ingestion Operations Engineer to join our data-driven teams. You will configure and test ingestion workflows, integrate sources into Hadoop, and ensure reliable production pipelines.

In this role you will troubleshoot ingestion issues, work within an Agile environment, and collaborate with engineering teams. Strong Unix/Linux, SQL, Git, Jenkins, and English skills are essential.

Qualifications

• Hands-on experience with Unix/Linux systems.
• Proficient in SQL and data querying.
• Experience with Git and Jenkins for CI/CD.
• Strong troubleshooting and problem-solving abilities.
• Experience working in an Agile environment.
• Good command of English (spoken and written).

Responsibilities

• Prepare and test configurations for data ingestion using ARC Ingestion Framework.
• Ingest data sources into Hadoop.
• Maintain data sources already ingested in production.
• Troubleshoot issues related to ingestion processes and configurations.
• Work in an Agile environment.

Skills

Unix/Linux

SQL

Git

Jenkins

Troubleshooting

Agile

English (spoken & written)

Tools

ARC Ingestion Framework

Hadoop

Robot Framework

Jira

Confluence

Helix

Python

Job description

Stanowisko: Data Ingestion Operations Engineer

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Data Ingestion Operations Engineer

Responsibilities:

• Prepare and test configurations for data ingestion using ARC Ingestion Framework
• Ingest data sources into Hadoop
• Maintain data sources already ingested in production
• Troubleshoot issues related to ingestion processes and configurations
• Work in an Agile environment

Requirements:

• Hands-on experience with Unix / Linux
• Practical knowledge of SQL
• Experience with Git
• Familiarity with Jenkins
• Ability to troubleshoot technical issues
• Strong rational thinking and problem-solving skills
• Experience working in an Agile environment
• Experience working with different applications and configurations
• Very good command of English, both spoken and written

Nice to have:

• Experience with testing
• Familiarity with Hadoop
• Experience with Robot Framework
• Knowledge of Jira, Confluence, or Helix
• Basic Python knowledge

Offer:

• Private medical care
• Co-financing for the sports card
• Constant support of dedicated consultant