Lead Big Data Engineer - Cloud Pipelines & Analytics

Compunnel, Inc.; Atlanta (GA); On-site; USD 120,000 - 150,000; Full time

Job summary

A technology firm is seeking a Lead Data Engineer - Big Data to design and maintain cloud-based data pipelines for enterprise applications. This role involves leading data-driven solutions and collaborating closely with business stakeholders to translate their requirements into effective data strategies. Ideal candidates should have extensive experience in Data Engineering, proficiency with Palantir Foundry, and a strong background in Hadoop technologies. A Bachelor's degree in Computer Science or similar is required.

Responsibilities

• Design and maintain cloud-based data pipelines to process enterprise data.
• Establish best practices for data analytics technologies.
• Lead delivery of data-driven solutions.
• Act as liaison between business units and technical teams.
• Support enterprise-wide reporting and analytics.
• Guide teams on efficient data management.
• Provide leadership and contribution in cross-functional teams.
• Participate in the Agile SDLC.

Skills

Data Engineering experience

Subject Matter Expert (SME)

Palantir Foundry

Hadoop ecosystem technologies

Python

ETL concepts

cloud-based data platforms

NoSQL databases

relational databases

Git

analytical and problem-solving skills

communication skills

Education

Bachelor’s degree in Computer Science or related field

Job description

A technology firm is seeking a Lead Data Engineer - Big Data to design and maintain cloud-based data pipelines for enterprise applications. This role involves leading data-driven solutions and collaborating closely with business stakeholders to translate their requirements into effective data strategies. Ideal candidates should have extensive experience in Data Engineering, proficiency with Palantir Foundry, and a strong background in Hadoop technologies. A Bachelor's degree in Computer Science or similar is required.