Senior Data Engineer: Scale Data Pipelines & Lakehouse

Sales Consulting

United States

Remote

USD 120,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

AWS Certifications

Job summary

Sales Consulting seeks a Senior Data Engineer to design and optimize large-scale data infrastructure for advanced analytics. You will build ETL/ELT pipelines for network telemetry, interface with on-prem data collection systems, and implement Iceberg structures for time-series data.

You should have 5+ years with AWS Glue/S3/Athena, strong SQL, and experience in data lakehouse architectures. Familiarity with Spark, Flink, Airflow or Prefect and data formats like Parquet is a plus.

Qualifications

  • 5+ years of experience with AWS data stack (Glue, S3, Athena, IAM, Lake Formation, Lambda) in data lakehouse contexts.
  • Hands-on development with Java, Python or Scala for data processing.
  • Strong SQL skills and time-series data experience.
  • Familiarity with data formats (JSON, Avro, Parquet) and modern orchestration (Airflow/Prefect).
  • Knowledge of Iceberg table structures and time-series data processing is a plus.

Responsibilities

  • Design ETL/ELT pipelines for network telemetry data.
  • Interface with on-premises data collection systems.
  • Implement Iceberg table structures for time-series data.
  • Optimize data processing for analytics and machine learning workloads.
  • Ensure data quality, lineage, and observability.

Skills

Graph theory
SQL knowledge
English (B1)

Tools

AWS Glue
Amazon S3
Athena
IAM
Lake Formation
Lambda
Iceberg
Apache Iceberg
Spark
Flink
Airflow
Prefect
DuckDB
Parquet
JSON/Avro formats

Job description

Sales Consulting seeks a Senior Data Engineer to design and optimize large-scale data infrastructure for advanced analytics. You will build ETL/ELT pipelines for network telemetry, interface with on-prem data collection systems, and implement Iceberg structures for time-series data.

You should have 5+ years with AWS Glue/S3/Athena, strong SQL, and experience in data lakehouse architectures. Familiarity with Spark, Flink, Airflow or Prefect and data formats like Parquet is a plus.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Data Engineer: AWS Lakehouse & Pipelines
Remote Senior Data Engineer: AWS Lakehouse & Pipelines

safeguardglobal • United States

Remote
USD 120,000 - 180,000
Flexible scheduling
Paid family bonding leave
Two paid charitable days
+3
Senior Data Engineer: Architect Lakehouse Pipelines
Senior Data Engineer: Architect Lakehouse Pipelines

Dynata • United States

Remote
USD 150,000 - 190,000
Luxoft_Senior Data Engineer / Developer (AWS)
Luxoft_Senior Data Engineer / Developer (AWS)

Sales Consulting • United States

Remote
USD 120,000 - 180,000
AWS Certifications
Senior Data Engineer: Scalable ETL & Lakehouse Pipelines
Senior Data Engineer: Scalable ETL & Lakehouse Pipelines

Ethereum Technologies • San Jose (CA)

On-site
USD 130,000 - 200,000
Senior Data Engineer: Scalable Pipelines & Data Quality
Senior Data Engineer: Scalable Pipelines & Data Quality

TechDigital Group • Burbank (CA)

On-site
USD 120,000 - 150,000
Senior AWS Data Engineer: Lakehouse & AI-Driven Pipelines
Senior AWS Data Engineer: Lakehouse & AI-Driven Pipelines

Global Business Ser. 4u Inc. • New York (NY)

On-site
USD 140,000 - 190,000
Senior Data Engineer: Real-Time Pipelines on AWS
Senior Data Engineer: Real-Time Pipelines on AWS

eOne Infotech • Fort Mill (SC)

On-site
USD 90,000 - 120,000
Senior Data Engineer: Lead Scalable ETL & AI Pipelines
Senior Data Engineer: Lead Scalable ETL & AI Pipelines

Iscale Solutions • United States

Remote
USD 120,000 - 180,000
Salary package
Vacation and sick leave
Health coverage
+6
Senior Data Engineer: Architect Scalable Data Pipelines
Senior Data Engineer: Architect Scalable Data Pipelines

SalesIntel Research, Inc. • United States

Remote
USD 100,000 - 130,000
Senior Data Engineer - Scalable Pipelines & ML-Ready Data
Senior Data Engineer - Scalable Pipelines & ML-Ready Data

Compunnel Inc. • Jersey City (NJ)

On-site
USD 100,000 - 130,000