Senior Data Engineer: Build Scalable Data Pipelines & ML

TripleLift

New York (NY)

On-site

USD 130,000 - 170,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, Dental & Vision Plans
Flexible PTO
401k w/ employer match
Full benefits after onboarding

Job summary

TripleLift is seeking a Senior Data Engineer to join a small, influential Data Engineering team. This hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

The Senior Data Engineer will support our software engineers, product managers, business intelligence analysts and data scientists on data initiatives, ensuring optimal data delivery across projects.

Qualifications

  • Bachelor’s degree in Computer Science or related field.
  • 5+ years of professional software engineering experience in production at scale.
  • Experience with optimizing big data and ML pipelines like Spark and Kafka at scale.
  • Fundamental knowledge of ML and AI operations; MLFlow, Feast, Ray are a plus.
  • Understanding of databases such as OpenSearch, Druid, Clickhouse, InfluxDB.
  • Proven cross-functional data modeling experience; strong SQL and programming in Python/Scala/Java.
  • Experience with containerization, Kubernetes and ArgoCD is a plus.

Responsibilities

  • Create and maintain optimal data pipeline architecture.
  • Assemble large, complex data sets that meet functional/non-functional requirements.
  • Identify and implement internal process improvements to automate and optimize data delivery.
  • Build infrastructure for ETL using Spark, EMR, Kafka and other big data technologies.
  • Collaborate with product managers, engineers and analysts to support data infrastructure needs.

Skills

Data pipeline design
Big data frameworks
Spark
Kafka
SQL
Python
Scala
Java
Kubernetes
Cross-functional collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Spark
Kafka
OpenSearch
Druid
ClickHouse

Job description

TripleLift is seeking a Senior Data Engineer to join a small, influential Data Engineering team. This hire will be responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams.

The Senior Data Engineer will support our software engineers, product managers, business intelligence analysts and data scientists on data initiatives, ensuring optimal data delivery across projects.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

TripleLift • New York (NY)

On-site
USD 130,000 - 170,000
Medical, Dental & Vision Plans
Flexible PTO
401k w/ employer match
+1
Data Engineer: Build Scalable Pipelines & Trusted Data
Data Engineer: Build Scalable Pipelines & Trusted Data

Liftify Prime Hospitality Group • United States

On-site
USD 110,000 - 150,000
Comprehensive benefits
Flexible PTO
401(k)
Senior Data Engineer - Remote AI-Driven Data Pipelines Leader
Senior Data Engineer - Remote AI-Driven Data Pipelines Leader

Truelogic Software LLC • United States

Remote
USD 120,000 - 180,000
100% Remote Work
Highly Competitive USD Pay
Paid Time Off
+2
Senior ML Engineer: Bidding Optimization & Production Systems
Senior ML Engineer: Bidding Optimization & Production Systems

TripleLift • New York (NY)

On-site
USD 140,000 - 170,000
Medical, Dental & Vision
Flexible PTO
401k match
+1
Senior Data Engineer: Scale Data Pipelines & AI
Senior Data Engineer: Scale Data Pipelines & AI

Code and Theory, LLC • New York (NY)

On-site
USD 120,000 - 160,000
Lead Data Engineer: Scalable Pipelines & AI-Driven Insights
Lead Data Engineer: Scalable Pipelines & AI-Driven Insights

Code and Theory, LLC • Chicago (IL)

On-site
USD 120,000 - 160,000
Senior Data Engineer - Scalable Pipelines & Insights
Senior Data Engineer - Scalable Pipelines & Insights

Partner Company • United States

Remote
USD 90,000 - 130,000
Senior Data Engineer: Build Scalable Data Pipelines
Senior Data Engineer: Build Scalable Data Pipelines

Kula Example • San Francisco (CA)

On-site
USD 190,000 - 230,000
Senior Data Platform Engineer: Scalable Pipelines & ML
Senior Data Platform Engineer: Scalable Pipelines & ML

Curate Partners • Boston (MA)

On-site
USD 120,000 - 150,000
Senior Data Engineer - Scalable Pipelines & ML-Ready Data
Senior Data Engineer - Scalable Pipelines & ML-Ready Data

Compunnel Inc. • Jersey City (NJ)

On-site
USD 100,000 - 130,000