Senior Data Engineer: Production-Grade Lakehouse Pipelines

Aloola.io

Beverly Hills (CA)

Vor Ort

USD 150.000 - 230.000

Vollzeit

vor 15 Stunden
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Aloola.io is seeking a Senior Data Engineer with 5+ years of experience to design, build, and operate a production data platform end to end. You will own ingestion, transformation, orchestration, and data quality on a modern cloud warehouse and lakehouse stack.

This hands-on role requires ownership of performance, cost, and reliability in production. You will work with Redshift or Databricks, Airflow, dbt, and Spark to implement pipelines, governance, and observability for trusted analytics

Qualifikationen

  • 5+ years of data engineering experience in production environments.
  • Experience with cloud data warehouses/lakehouses (Redshift, Databricks).
  • Proficiency in Airflow, dbt, and Spark-based transformations.
  • Experience with data ingestion tools (Fivetran, Airbyte, AWS DMS, Kafka/Kinesis).
  • Hands-on with open table formats (Iceberg, Delta Lake, or Hudi).
  • Strong SQL skills including window functions and optimization.
  • Familiarity with data governance, quality checks, and observability tools.

Aufgaben

  • Own data models and pipelines on Amazon Redshift or Databricks, including performance tuning and cost management.
  • Author and operate Apache Airflow DAGs at scale, managing dependencies, retries, SLAs, and observability.
  • Build and maintain dbt transformations: model design, testing, macros, documentation, and CI/CD.
  • Develop and run ingestion pipelines using tools such as Fivetran, Airbyte, AWS DMS, Kafka/Kinesis, or custom CDC/API ingestion.
  • Manage lakehouse tables in open formats (Iceberg, Delta Lake, or Hudi), including partitioning, schema evolution, and time travel.
  • Write large-scale batch and streaming transformations in PySpark or Spark SQL.
  • Write advanced SQL and production-grade Python across the platform.
  • Implement data governance, quality checks, and observability to catch issues before data consumers.

Kenntnisse

SQL
Python
Data governance

Tools

Amazon Redshift
Databricks
Apache Airflow
dbt
Fivetran
Airbyte
AWS DMS
Kafka/Kinesis
Apache Iceberg
Delta Lake
Hudi
PySpark
Spark SQL
Great Expectations
Monte Carlo
Terraform
Docker
GitHub Actions

Jobbeschreibung

Aloola.io is seeking a Senior Data Engineer with 5+ years of experience to design, build, and operate a production data platform end to end. You will own ingestion, transformation, orchestration, and data quality on a modern cloud warehouse and lakehouse stack.

This hands-on role requires ownership of performance, cost, and reliability in production. You will work with Redshift or Databricks, Airflow, dbt, and Spark to implement pipelines, governance, and observability for trusted analytics

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Senior Data Engineer: Architect Lakehouse Pipelines
Senior Data Engineer: Architect Lakehouse Pipelines

Dynata • USA

Remote
USD 150.000 - 190.000
Senior Data Engineer - Lakehouse & Streaming Platforms
Senior Data Engineer - Lakehouse & Streaming Platforms

Ethereum Technologies LLC • Atlanta (GA)

Vor Ort
USD 120.000 - 180.000
Senior Data Engineer: Lakehouse & Streaming Pipelines
Senior Data Engineer: Lakehouse & Streaming Pipelines

Robotics Technologies • Atlanta (GA)

Vor Ort
USD 120.000 - 180.000
Senior Data Engineer - Lakehouse & Pipelines
Senior Data Engineer - Lakehouse & Pipelines

ZoomInfo Technologies LLC • Bethesda (MD), Vancouver (WA), Waltham (MA)

Hybrid
USD 112.000 - 176.000
Senior Data Engineer: Scale Data Pipelines & Lakehouse
Senior Data Engineer: Scale Data Pipelines & Lakehouse

Sales Consulting • USA

Remote
USD 120.000 - 180.000
AWS Certifications
Senior Data Platform Engineer: Lakehouse, Streaming & CI/CD
Senior Data Platform Engineer: Lakehouse, Streaming & CI/CD

Robotic Process Automation LLC • Atlanta (GA)

Vor Ort
USD 120.000 - 180.000
Data Engineer: Real-Time Lakehouse & Pipelines
Data Engineer: Real-Time Lakehouse & Pipelines

Nouvells • USA

Remote
USD 120.000 - 180.000
Remote Senior Data Engineer: AWS Lakehouse & Pipelines
Remote Senior Data Engineer: AWS Lakehouse & Pipelines

safeguardglobal • USA

Remote
USD 120.000 - 180.000
Flexible scheduling
Paid family bonding leave
Two paid charitable days
+3
Senior Data Platform Engineer — Lakehouse & AI Pipelines
Senior Data Platform Engineer — Lakehouse & AI Pipelines

Qualified Health PBC • USA

Hybrid
USD 215.000 - 235.000
Equity
Medical/Dental/Vision insurance
Flexible working hours
+1
Senior Data Developer: Lakehouse Pipelines & Observability
Senior Data Developer: Lakehouse Pipelines & Observability

Ciandt • USA

Remote
USD 120.000 - 180.000
Health and dental insurance
Meal and food allowance
Childcare assistance
+2