Data Operations Engineer: Linux, SQL & Hadoop Ingestion

DCG Poland; Województwo mazowieckie; On-site; PLN 169,348 - 254,022; Full time

Benefits offered by this job

Private medical care

Co‑financing for the sports card

Constant support of dedicated consultant

Job summary

DCG Poland is looking for a Data Operations Engineer to handle data ingestion into Hadoop and maintain data sources in production. The successful candidate will collaborate in an Agile environment, troubleshoot operational issues, and ensure stable ingestion operations. Candidates should have experience with Unix/Linux, SQL, Git, and possess strong analytical skills. The role also offers private medical care and co-financing for a sports card.

Qualifications

• Experience working with Unix / Linux environments.
• Good knowledge of SQL.
• Experience using Git.
• Strong analytical and rational thinking skills.
• Experience working in an Agile setup.
• Very good command of English, both spoken and written.

Responsibilities

• Ingest data into Hadoop using the ARC Ingestion Framework.
• Prepare, configure, and test data ingestion setups for new data sources.
• Maintain and support data sources already running in production.
• Work with different applications and configurations related to data ingestion.
• Troubleshoot ingestion issues and operational problems.
• Collaborate within an Agile environment.
• Ensure stable and reliable ingestion operations through systematic and rational problem-solving.

Skills

Unix / Linux environments

SQL

Git

Analytical thinking

Agile

English communication

Tools

Hadoop

Jenkins

Robot Framework

Jira

Confluence

Helix

Python

Job description

DCG Poland is looking for a Data Operations Engineer to handle data ingestion into Hadoop and maintain data sources in production. The successful candidate will collaborate in an Agile environment, troubleshoot operational issues, and ensure stable ingestion operations. Candidates should have experience with Unix/Linux, SQL, Git, and possess strong analytical skills. The role also offers private medical care and co-financing for a sports card.