Lead Data Engineer — Real-Time Pipelines & Architecture

Human Power BG; New York (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

A leading performance marketing company in New York is searching for a Lead Software Engineer specializing in data pipelines. This role involves developing micro batch and real-time streaming systems while leading a team of data engineers. Candidates should have experience with big data tools, Java, Scala, and possess strong leadership skills. This position offers an opportunity to work in an innovative environment focused on scalability and efficiency, with a competitive compensation package.

Qualifications

• BA/BS or MS degree in Computer Science preferred, or equivalent work experience.
• Understanding of distributed data systems.
• Previous leadership and team management experience.

Responsibilities

• Contribute to the development of Micro Batch/Real Time streaming pipelines.
• Collaborate with key stakeholders to drive the architecture strategies.
• Maintain a culture of innovation in alignment with scalability and security.

Skills

Distributed data systems

Leadership and team management

Java

Scala

Bigtable

Apache Spark

BigQuery

Education

BA/BS or MS degree in Computer Science

Tools

Apache Spark Streaming

Golang

Job description

A leading performance marketing company in New York is searching for a Lead Software Engineer specializing in data pipelines. This role involves developing micro batch and real-time streaming systems while leading a team of data engineers. Candidates should have experience with big data tools, Java, Scala, and possess strong leadership skills. This position offers an opportunity to work in an innovative environment focused on scalability and efficiency, with a competitive compensation package.