Junior Data Engineer - Real-Time Data Pipelines

Human Power BG; United States; On-site; USD 120,000 - 150,000; Full time

Job summary

Human Power BG is seeking a Data Engineer to build the backbone of our data platform, tackling micro-batch and real-time streaming pipelines using BigQuery, Bigtable, Spark, and Kubernetes in production.

Collaborate with data science and engineering teams to preprocess data, shape data structures, and ensure scalable, secure, low-latency systems. Experience with Google Cloud and distributed data systems is highly valued.

Qualifications

• BS/MS in CS or equivalent experience.
• Understanding of distributed data systems.
• Experience with Java and Scala.
• Experience with Bigtable, BigQuery, Spark, Spark Streaming, Heron.
• Google Cloud and Kubernetes preferred.
• Production Golang systems, infrastructure background, low latency/high throughput design.

Responsibilities

• Contribute to the development of micro batch/real-time streaming pipelines (lambda architecture).
• Work closely with the engineering team on data preprocessing and data structure.
• Collaborate with key stakeholders to drive the architecture strategies.
• Participate in architecture reviews.
• Maintain a culture of innovation, in an environment that requires high levels of scalability, security, and reliability.

Skills

Distributed data systems

Java

Scala

BigQuery

Spark

Kubernetes

Education

BS/MS in Computer Science

Tools

Bigtable

GCP (Google Cloud)

Job description

Human Power BG is seeking a Data Engineer to build the backbone of our data platform, tackling micro-batch and real-time streaming pipelines using BigQuery, Bigtable, Spark, and Kubernetes in production.

Collaborate with data science and engineering teams to preprocess data, shape data structures, and ensure scalable, secure, low-latency systems. Experience with Google Cloud and distributed data systems is highly valued.