Lead Big Data Engineer - Data Lake & Real-Time Ingest

360 IT Professionals; Atlanta (GA); On-site; USD 130,000 - 160,000; Full time

Job summary

A leading software development firm in Atlanta is looking for a Big Data Engineering Lead to manage the ingestion and governance of data. The role requires a strong background in distributed computing and experience with the Hadoop Ecosystem. Candidates must have a passion for software engineering and proficiency in Java and Scala. The position offers an opportunity to work in a collaborative environment focused on driving technical excellence and innovation.

Qualifications

• Bachelor’s degree or higher in Computer Science or related field.
• Proven experience in developing Big Data solutions.
• Good understanding of distributed computing and big data architectures.

Responsibilities

• Lead a Big Data engineering team focusing on data ingestion.
• Participate in the design and development of the new data lake.
• Inspire the team and cultivate engineering mindset.

Skills

Proficient in distributed computing

Experience with Apache NiFi

Knowledge of NoSQL databases

Understanding of Agile methodologies

Capable of developing in Java

Strong coding skills

Education

Bachelor’s degree in Computer Science

Tools

Hadoop Ecosystem

ETL tools (Talend, Pentaho)

Docker

Git

Job description

A leading software development firm in Atlanta is looking for a Big Data Engineering Lead to manage the ingestion and governance of data. The role requires a strong background in distributed computing and experience with the Hadoop Ecosystem. Candidates must have a passion for software engineering and proficiency in Java and Scala. The position offers an opportunity to work in a collaborative environment focused on driving technical excellence and innovation.