Remote Senior Data Engineer: Scalable ETL & Streaming

Diverse Lynx, LLC

Oregon

Hybrid

USD 120,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Diverse Lynx LLC is seeking a Senior Data Engineer in Sunnyvale, CA (Remote) to design, build, and optimize data pipelines for analytics, AI/ML, and reporting. You will implement data quality controls, governance, and reliable data movement across platforms, leveraging Kafka, PySpark, Airflow, and Hive.

The role emphasizes scalable ETL/ELT development, ingestion automation, and collaboration with data teams to support advanced analytics initiatives. Remote-friendly for the US market.

Qualifications

  • Experience with big data processing landscapes and building reliable data pipelines.
  • Proficiency with Python-based data tooling and Spark-based processing.
  • Strong knowledge of data quality, governance, and monitoring practices.

Responsibilities

  • Design, build, and maintain scalable ETL/ELT pipelines.
  • Automate data ingestion from multiple data sources.
  • Develop and optimize PySpark-based data processing frameworks.
  • Build and manage Airflow workflows and orchestration pipelines.
  • Work with Hive and Kafka-based batch and streaming data solutions.

Skills

Kafka
Python
PySpark
Airflow
Hive
ETL testing

Tools

Google Cloud Platform

Job description

Diverse Lynx LLC is seeking a Senior Data Engineer in Sunnyvale, CA (Remote) to design, build, and optimize data pipelines for analytics, AI/ML, and reporting. You will implement data quality controls, governance, and reliable data movement across platforms, leveraging Kafka, PySpark, Airflow, and Hive.

The role emphasizes scalable ETL/ELT development, ingestion automation, and collaboration with data teams to support advanced analytics initiatives. Remote-friendly for the US market.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Diverse Lynx, LLC • Oregon

Hybrid
USD 120,000 - 150,000
Remote Senior Data Engineer — ETL, Spark & Kafka
Remote Senior Data Engineer — ETL, Spark & Kafka

MBO Partners • United States

Remote
USD 90,000 - 130,000
Eligibility for Paid Sick Leave (PSL)
Flexible working hours
Senior Big Data Engineer - Remote Analytics & Pipelines
Senior Big Data Engineer - Remote Analytics & Pipelines

Placements24 • United States

Remote
USD 120,000 - 180,000
Fully remote work
Home office setup allowance
Professional development & conferences
+2
Remote Data Engineer: Scale Big Data Pipelines
Remote Data Engineer: Scale Big Data Pipelines

VORKIS knows what employer wants • United States

Remote
USD 65,000 - 79,000
Work from home
Senior AWS Data Engineer: ETL & Real-Time Pipelines
Senior AWS Data Engineer: ETL & Real-Time Pipelines

Diverse Lynx, LLC • Malvern

On-site
USD 68,000 - 97,000
Sr. Data Engineer (Remote)
Sr. Data Engineer (Remote)

modemobile • United States

Remote
USD 160,000 - 260,000
Company equity
Performance bonus
Open PTO
+3
Senior Databricks Engineer - Scala & Spark
Senior Databricks Engineer - Scala & Spark

Diverse Lynx, LLC • Quincy (MA)

On-site
USD 130,000 - 170,000
Remote Data Engineer: Build Scalable Cloud Pipelines
Remote Data Engineer: Build Scalable Cloud Pipelines

SpaceCoast AV Consultants • Florida

Remote
USD 110,000 - 140,000
Health, dental, and vision insurance
401(k) with company matching
Generous paid time off and parental leave
+1
Remote Senior Data Engineer: Pipelines, Warehousing & Cloud
Remote Senior Data Engineer: Pipelines, Warehousing & Cloud

QuadSoft Technologies • Texas

Remote
USD 100,000 - 130,000
Senior Data Engineer - ELT/Streaming Pipelines, Remote
Senior Data Engineer - ELT/Streaming Pipelines, Remote

Troveo AI • United States

Remote
USD 160,000 - 175,000
Health benefits
Flexible PTO
Remote-first policy (US)
+2