[IT] LEAD SOFTWARE ENG | DATA

Human Power BG

New York (NY)

On-site

USD 120,000 - 150,000

Full time

14 days+
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A leading performance marketing company in New York is searching for a Lead Software Engineer specializing in data pipelines. This role involves developing micro batch and real-time streaming systems while leading a team of data engineers. Candidates should have experience with big data tools, Java, Scala, and possess strong leadership skills. This position offers an opportunity to work in an innovative environment focused on scalability and efficiency, with a competitive compensation package.

Qualifications

  • BA/BS or MS degree in Computer Science preferred, or equivalent work experience.
  • Understanding of distributed data systems.
  • Previous leadership and team management experience.

Responsibilities

  • Contribute to the development of Micro Batch/Real Time streaming pipelines.
  • Collaborate with key stakeholders to drive the architecture strategies.
  • Maintain a culture of innovation in alignment with scalability and security.

Skills

Distributed data systems
Leadership and team management
Java
Scala
Bigtable
Apache Spark
BigQuery

Education

BA/BS or MS degree in Computer Science

Tools

Apache Spark Streaming
Golang

Job description

About the job [IT] LEAD SOFTWARE ENG | DATA

The Data Engineering team is developing the backbone of *** solutions. To do this, the team is using cutting-edge technologies and frameworks such as BigQuery, Spanner, Bigtable, & Dataproc to process and analyze data, to help create the pipelines required to handle millions of events daily, and collaborate with the data science team to enable the innovative work in machine learning and AI to be utilized in our production environment.

Responsibilities
  • Contribute to the development of *** Micro Batch/Real Time streaming pipelines (lambda architecture)
  • Work closely with the engineering team on data preprocessing and data structure
  • Ability to lead and develop team of data engineers
  • Help mentoring the data engineering team and leading the data engineering initiatives
  • Collaborate with key stakeholders to drive the architecture strategies
  • Participate in architecture reviews
  • Maintain a culture of innovation, in an environment that requires high levels of scalability, security, and reliability
Qualifications
  • BA/BS or MS degree in Computer Science preferred, or equivalent work experience
  • Understanding of distributed data systems
  • Previous leadership and team management experience
  • Previous experience with Java and Scala
  • Previous experience working with big data tools such as Bigtable, Apache Spark, Apache Spark Streaming, Apache Heron, BigQuery

Preferred:

  • Experience running production Golang systems, Infrastructure background, Low Latency / High Throughput Architectural System Design
  • Eagerness to learn new technologies on the fly and ship to production
  • Knowledge in data science is a plus
  • Experience working on diverse teams a plus

*** is proud to be an equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status.

JOIN US ON OUR MISSION

*** is a leading performance marketing engine that delivers tailored experiences at scale. Digital businesses use *** to remember who users are better than ever before, allowing them to deliver high-performing, one-to-one messages on websites, through emails and texts, and in ads at a scale that’s not otherwise possible. *** recently acquired &&& so marketers can now unlock more revenue than ever before across SMS and email.

*** drives $1.2 billion dollars annually in directly attributable revenue for top eCommerce brands like Uniqlo, Sonos and HelloFresh, often ranking as a top-3 revenue channel in their own analytics. *** is maniacally obsessed with ROI and aims to be the infrastructural interface between individuals and brands in a world where consumers choose what they want, from whom, and when.

Having raised over$44.9 millionin funding from proven firms like Battery Ventures, Cross Creek Advisors and Primary Ventures, *** was named the Fastest Growing Software Company in America by Inc Magazine . With headquarters inNew YorkandLondon, *** has been recognized by Glassdoor and Crain's for its exceptional culture and being one of the top places to work in the country. The company recently signed both the White House Equal Pay Pledge and the United Nations Women's Empowerment Pledge and continues to set the bar as a pioneer in technology innovation and workplace inclusion initiatives.

What bonds our community together is our commitment to 5 Core Values:

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

[IT] SOFTWARE ENG - DATA | SENIOR
[IT] SOFTWARE ENG - DATA | SENIOR

Human Power BG • New York (NY)

On-site
USD 120,000 - 150,000
Equal opportunity workplace
Exceptional company culture
[IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID
[IT] SOFTWARE ENGINEER - DATA | JUNIOR / MID

Human Power BG • New York (NY)

On-site
USD 80,000 - 110,000
Software Engineer, Data Runtime
Software Engineer, Data Runtime

Talanto • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 230,000
Comprehensive Medical, Vision, and Ddn
Generous Vacation Policy
Enhanced Parental Leave
+1
Staff Software Engineer - Data Platform
Staff Software Engineer - Data Platform

Harnham • United States

Hybrid
USD 260,000 - 325,000
Significant equity upside
Catered lunch daily
401K match (up to 4%)
+5
Lead Data Engineer
Lead Data Engineer

Talanto • Northern (KY)

Hybrid
USD 125,000 - 182,000
Medical, dental, vision and life
401(k) with company match
Tuition reimbursement
+3
Manager, Software Engineering - Data Platform
Manager, Software Engineering - Data Platform

United States Digital Space LLC • United States

Remote
USD 258,000 - 376,000
Equity compensation
Health, dental, and vision coverage
Retirement benefits with company contr
Data Operations Analyst
Data Operations Analyst

ScrumLaunch LLC. • New York (NY)

Remote
USD 70,000 - 90,000
12 vacation days per year
5 sick days per year
Access to therapist and psychologist support
Senior Vice President, Data Operations
Senior Vice President, Data Operations

Meredith Corporation • Town of Liberty (NY)

Hybrid
USD 315,000 - 375,000
Annual bonuses and long-term incentives
Unlimited paid time off
401(k) with company match
Staff Engineer (Product)
Staff Engineer (Product)

Talanto • Boston (MA), Northern (KY)

Hybrid
USD 175,000 - 250,000
Data Engineer
Data Engineer

Jobot • Chicago (IL)

On-site
USD 180,000 - 250,000