Lead Data Engineer – Real-Time Streaming & Architecture

Human Power BG

United States

Remote

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Human Power BG is seeking a senior data engineering leader to drive real-time and batch data pipelines across our high-scale infrastructure. You will mentor a growing team, collaborate with stakeholders, and shape architecture for low-latency, secure systems.

The role emphasizes leadership, hands-on work with Java/Scala and Spark, and experience with Google Cloud and Kubernetes. You will contribute to scalable, reliable data solutions and production-ready deployments.

Qualifications

  • BA/BS or MS in Computer Science preferred, or equivalent work experience.
  • Understanding of distributed data systems.
  • Previous leadership and team management experience.
  • Previous experience with Java and Scala.
  • Previous experience working with big data tools such as Bigtable, Apache Spark, Apache Spark Streaming, Apache Heron, BigQuery.
  • Preferred: Google Cloud, Kubernetes Experience running production Golang systems, Infrastructure background, Low Latency / High Throughput Architectural System Design.
  • Strong interest in data engineering.
  • Eagerness to learn new technologies on the fly and ship to production.
  • Knowledge in data science is a plus.
  • Experience working on diverse teams a plus.

Responsibilities

  • Contribute to the development of Micro Batch/Real Time streaming pipelines (lambda architecture).
  • Work closely with the engineering team on data preprocessing and data structure.
  • Ability to lead and develop team of data engineers.
  • Help mentoring the data engineering team and leading the data engineering initiatives.
  • Collaborate with key stakeholders to drive the architecture strategies.
  • Participate in architecture reviews.
  • Maintain a culture of innovation, in an environment that requires high levels of scalability, security, and reliability.

Skills

Leadership
Data engineering
Java
Scala
Big data

Education

CS degree

Tools

BigQuery
Bigtable
Apache Spark
Apache Spark Streaming
Apache Heron

Job description

Human Power BG is seeking a senior data engineering leader to drive real-time and batch data pipelines across our high-scale infrastructure. You will mentor a growing team, collaborate with stakeholders, and shape architecture for low-latency, secure systems.

The role emphasizes leadership, hands-on work with Java/Scala and Spark, and experience with Google Cloud and Kubernetes. You will contribute to scalable, reliable data solutions and production-ready deployments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer (Junior–Mid) — Real-Time Pipelines & Big Data
Data Engineer (Junior–Mid) — Real-Time Pipelines & Big Data

Human Power BG • United States

Remote
USD 120,000 - 180,000
Lead Data Engineer: Real-Time Pipelines & Spark/Kafka
Lead Data Engineer: Real-Time Pipelines & Spark/Kafka

Mode.Inc • United States

Remote
USD 140,000 - 210,000
Senior Data Engineer — Real-Time Data Platforms Lead
Senior Data Engineer — Real-Time Data Platforms Lead

HITEC • Charlotte (NC)

On-site
USD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Sunnyvale (CA)

On-site
USD 100,000 - 140,000
Lead Data Engineer: Scale Data Lakes & Real-Time Pipelines
Lead Data Engineer: Scale Data Lakes & Real-Time Pipelines

Good co India • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

The Value Maximizer • South Carolina

On-site
USD 120,000 - 150,000
Lead Data Platform Engineer — Real-Time Data & AI
Lead Data Platform Engineer — Real-Time Data & AI

Elastic • Mountain View (CA)

On-site
USD 113,000 - 179,000
Health coverage
Flexible schedules
Vacation days
+5
Senior Data Engineer - Real-Time Pipelines (Spark/Kafka)
Senior Data Engineer - Real-Time Pipelines (Spark/Kafka)

UST • Sunnyvale (CA)

On-site
USD 72,000 - 108,000
Medical Insurance
401(k) with employer match
Paid time off
Senior Lead Data Platform Engineer (Streaming & AI)
Senior Lead Data Platform Engineer (Streaming & AI)

ARCHER • Wilmington (DE)

On-site
USD 140,000 - 190,000
Health Coverage
On-Site Wellness Centers
Retirement Savings
+4
Lead Data Engineer
Lead Data Engineer

TechDigital Group • Warsaw (IN)

On-site
USD 80,000 - 120,000