Lead Big Data Engineer - Hadoop & Data Lake

Arete Technologies, Inc.; Atlanta (GA); On-site; USD 100,000 - 140,000; Full time

Job summary

Arete Technologies, Inc. is seeking a Big Data Engineering Lead in Atlanta, GA, specializing in data ingestion from diverse systems. The role involves collaboration in developing the NCR Data Lake and inspiring the engineering team towards technical excellence.

The ideal candidate will have a Bachelor's degree in Computer Science and extensive experience with tools like Apache NiFi and Kafka. Familiarity with Agile practices and DevOps is also required.

Qualifications

• Good understanding of distributed computing and big-data architectures.
• Proven experience in developing Big Data solutions in the Hadoop Ecosystem.
• Experience with at least one NoSQL database like HBase or Cassandra.
• DevOps experience with CI and CD principles.

Responsibilities

• Lead a Big Data engineering team with data ingestion focus.
• Participate in collaborative design of the NCR Data Lake.
• Inspire team with an engineering mindset and systems thinking.

Skills

Apache NiFi

Kafka

Flume

Sqoop

Hive

HDFS

HBase

Spark

Java

Scala

DevOps

Education

Bachelor’s degree in Computer Science or related field

Tools

Maven

Git

Docker

Talend

Job description

Arete Technologies, Inc. is seeking a Big Data Engineering Lead in Atlanta, GA, specializing in data ingestion from diverse systems. The role involves collaboration in developing the NCR Data Lake and inspiring the engineering team towards technical excellence.

The ideal candidate will have a Bachelor's degree in Computer Science and extensive experience with tools like Apache NiFi and Kafka. Familiarity with Agile practices and DevOps is also required.