Data Engineering Lead: Hadoop & Real-Time Pipelines

Cloud Analytics Technologies, LLC; Cleveland (OH); On-site; USD 120,000 - 150,000; Full time

Job summary

A data analytics firm located in Cleveland, Ohio, is looking for a Data Engineering Lead. This role involves leading and optimizing data pipelines, architecting data frameworks, and ensuring technical excellence within the team. The perfect candidate will have over 8 years in data engineering, experience with Hadoop, and proficiency in tools like Spark and AWS. Strong leadership and communication skills are essential. Join a collaborative and inclusive work environment focused on innovation and technical growth.

Qualifications

• 8–10 years of experience in data engineering, with at least 2–3 years in a technical leadership role.
• Strong expertise in the Hadoop ecosystem (HDFS, Hive, MapReduce, HBase, Pig, etc.).
• Proficiency in Python and Scala for large-scale data processing.

Responsibilities

• Lead and oversee the design, implementation, and optimization of data pipelines.
• Architect and implement data ingestion, transformation, and storage frameworks.
• Provide technical leadership and mentorship to a team of data engineers.

Skills

Data engineering

Technical leadership

Hadoop ecosystem

ETL / ELT pipelines

Data modeling

SQL

Tools

Hadoop

Spark

Flink

Airflow

NiFi

AWS

Avro

Parquet

Job description

A data analytics firm located in Cleveland, Ohio, is looking for a Data Engineering Lead. This role involves leading and optimizing data pipelines, architecting data frameworks, and ensuring technical excellence within the team. The perfect candidate will have over 8 years in data engineering, experience with Hadoop, and proficiency in tools like Spark and AWS. Strong leadership and communication skills are essential. Join a collaborative and inclusive work environment focused on innovation and technical growth.