Lead Data Engineer - Big Data

Compunnel Inc.

Atlanta (GA)

Sur place

USD 120 000 - 150 000

Plein temps

14 jours+

Obtenez une réponse de ce recruteur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

A technology firm is seeking a Lead Data Engineer - Big Data to design and maintain cloud-based data pipelines for enterprise applications. This role involves leading data-driven solutions and collaborating closely with business stakeholders to translate their requirements into effective data strategies. Ideal candidates should have extensive experience in Data Engineering, proficiency with Palantir Foundry, and a strong background in Hadoop technologies. A Bachelor's degree in Computer Science or similar is required.

Responsabilités

  • Design and maintain cloud-based data pipelines to process enterprise data.
  • Establish best practices for data analytics technologies.
  • Lead delivery of data-driven solutions.
  • Act as liaison between business units and technical teams.
  • Support enterprise-wide reporting and analytics.
  • Guide teams on efficient data management.
  • Provide leadership and contribution in cross-functional teams.
  • Participate in the Agile SDLC.

Connaissances

Data Engineering experience
Subject Matter Expert (SME)
Palantir Foundry
Hadoop ecosystem technologies
Python
ETL concepts
cloud-based data platforms
NoSQL databases
relational databases
Git
analytical and problem-solving skills
communication skills

Formation

Bachelor’s degree in Computer Science or related field

Description du poste

The Lead Data Engineer - Big Data will develop and support enterprise-scale business applications using modern Big Data technologies in a cloud-based environment. This role combines technical leadership with hands‑on data engineering and close collaboration with business stakeholders. The ideal candidate will architect, build, and manage complex data pipelines while translating business requirements into actionable data solutions that drive insights, efficiency optimization, and predictive analytics.

Key Responsibilities
  • Design, architect, and maintain cloud-based data pipelines to process and curate large-scale enterprise data
  • Establish best practices for cloud-based data analytics technologies to analyze high-volume manufacturing and financial data
  • Lead end-to-end delivery of data-driven and big data solutions
  • Act as a liaison between business units and technical teams to gather, analyze, and translate requirements
  • Support business analysts by enabling enterprise-wide reporting and analytics for leadership
  • Guide teams on efficient data and resource management using cloud-based platforms and services
  • Provide technical leadership and hands‑on contribution within cross‑functional teams of data engineers and analysts
  • Participate in the full Agile SDLC including design, development, unit testing, and peer reviews
Required Skills
  • 8–10 years of strong hands‑on Data Engineering experience
  • Experience working as a Subject Matter Expert (SME)
  • Hands‑on experience with Palantir Foundry for designing and implementing scalable data solutions
  • Strong experience with Hadoop ecosystem technologies such as Hive and PySpark
  • Proficiency in Python or Java
  • Solid understanding and practical experience with ETL concepts and at least one ETL technology
  • Experience with cloud-based data platforms and services
  • Strong experience with NoSQL databases (HBase, MongoDB, etc.)
  • Strong experience with relational databases (SQL Server, Oracle, MySQL, etc.)
  • Experience with source control systems, specifically Git
  • Strong analytical, critical thinking, and problem‑solving skills
  • Excellent communication skills for both technical and non‑technical audiences
Education

Bachelor’s degree in Computer Science or a related field

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Lead Big Data Engineer - Cloud Pipelines & Analytics
Lead Big Data Engineer - Cloud Pipelines & Analytics

Compunnel Inc. • Atlanta (GA)

Sur place
USD 120 000 - 150 000
Lead Data Engineer
Lead Data Engineer

Harnham • États-Unis

Sur place
USD 150 000 - 210 000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

Sur place
USD 120 000 - 150 000
Lead Data Engineer
Lead Data Engineer

Marlabs Inc. • États-Unis

Hybride
USD 120 000 - 180 000
Lead Data Engineer
Lead Data Engineer

Compunnel Inc. • Columbus (OH)

Sur place
USD 100 000 - 130 000
Lead Data Engineer
Lead Data Engineer

MarLabs • États-Unis

À distance
USD 140 000 - 190 000
Lead Data Engineer
Lead Data Engineer

Good co India • États-Unis

À distance
USD 120 000 - 180 000
Senior Data Engineer
Senior Data Engineer

Peyton Resource Group • Houston (TX)

Sur place
USD 120 000 - 150 000
Data Engineer Lead
Data Engineer Lead

Turtle Trax S.A. • États-Unis

Hybride
USD 140 000 - 180 000
Lead Data Engineer
Lead Data Engineer

TechDigital Group • Warsaw (IN)

Sur place
USD 80 000 - 120 000