Data Engineering Lead — Hadoop & Real-Time Pipelines

Robotics Prcocess Automation, LLC; Cleveland (OH); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading automation company in Cleveland is seeking an experienced Data Engineering Lead to oversee the design and optimization of data pipelines critical for customer workflows. The ideal candidate will have 8–10 years in data engineering and a strong background in the Hadoop ecosystem. Responsibilities include providing technical leadership, managing a team, and ensuring data security and compliance. This role not only demands technical proficiency but also excellent problem-solving and mentoring skills, making it an exciting opportunity for the right leader.

Qualifications

• 8–10 years of experience in data engineering, with 2–3 years in a technical leadership role.
• Strong expertise in the Hadoop ecosystem (HDFS, Hive, etc.).
• Proven ability to design and maintain ETL / ELT pipelines using tools such as Spark, Flink, etc.

Responsibilities

• Lead end-to-end design, implementation, and optimization of data pipelines.
• Architect frameworks using Hadoop, Avro, and distributed processing technologies.
• Provide technical leadership and mentorship to a team of data engineers.

Skills

Data engineering

Hadoop

ETL / ELT pipelines

SQL

Data modeling

Cloud platforms

Data governance

Problem-solving

Tools

Spark

Flink

Airflow

NiFi

AWS

HDFS

Hive

MapReduce

Job description

A leading automation company in Cleveland is seeking an experienced Data Engineering Lead to oversee the design and optimization of data pipelines critical for customer workflows. The ideal candidate will have 8–10 years in data engineering and a strong background in the Hadoop ecosystem. Responsibilities include providing technical leadership, managing a team, and ensuring data security and compliance. This role not only demands technical proficiency but also excellent problem-solving and mentoring skills, making it an exciting opportunity for the right leader.