Data Engineer - Junior/Mid | Real-Time & Big Data Pipelines

Human Power BG; New York (NY); On-site; USD 80,000 - 110,000; Full time

Job summary

A performance marketing firm in New York is seeking a Junior/Mid Software Engineer specializing in Data. The candidate will develop Micro Batch and Real Time streaming pipelines while collaborating with the engineering team on data structures. The role requires a background in Java, Scala, and experience with big data tools such as Bigtable and Apache Spark. This position offers opportunities for innovation in data processing and machine learning applications.

Qualifications

• Degree in Computer Science or equivalent experience.
• Understanding of distributed data systems.
• Experience with big data tools.

Responsibilities

• Develop Micro Batch/Real Time streaming pipelines.
• Collaborate on data preprocessing and structure.
• Participate in architecture reviews.

Skills

Java

Scala

Bigtable

Apache Spark

Data structures

Education

BA/BS or MS in Computer Science

Tools

BigQuery

Apache Spark Streaming

Job description

A performance marketing firm in New York is seeking a Junior/Mid Software Engineer specializing in Data. The candidate will develop Micro Batch and Real Time streaming pipelines while collaborating with the engineering team on data structures. The role requires a background in Java, Scala, and experience with big data tools such as Bigtable and Apache Spark. This position offers opportunities for innovation in data processing and machine learning applications.