Senior Data Engineer

Aloola.io

Beverly Hills (CA)

On-site

USD 150,000 - 230,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Aloola.io is seeking a Senior Data Engineer with 5+ years of experience to design, build, and operate a production data platform end to end. You will own ingestion, transformation, orchestration, and data quality on a modern cloud warehouse and lakehouse stack.

This hands-on role requires ownership of performance, cost, and reliability in production. You will work with Redshift or Databricks, Airflow, dbt, and Spark to implement pipelines, governance, and observability for trusted analytics

Qualifications

  • 5+ years of data engineering experience in production environments.
  • Experience with cloud data warehouses/lakehouses (Redshift, Databricks).
  • Proficiency in Airflow, dbt, and Spark-based transformations.
  • Experience with data ingestion tools (Fivetran, Airbyte, AWS DMS, Kafka/Kinesis).
  • Hands-on with open table formats (Iceberg, Delta Lake, or Hudi).
  • Strong SQL skills including window functions and optimization.
  • Familiarity with data governance, quality checks, and observability tools.

Responsibilities

  • Own data models and pipelines on Amazon Redshift or Databricks, including performance tuning and cost management.
  • Author and operate Apache Airflow DAGs at scale, managing dependencies, retries, SLAs, and observability.
  • Build and maintain dbt transformations: model design, testing, macros, documentation, and CI/CD.
  • Develop and run ingestion pipelines using tools such as Fivetran, Airbyte, AWS DMS, Kafka/Kinesis, or custom CDC/API ingestion.
  • Manage lakehouse tables in open formats (Iceberg, Delta Lake, or Hudi), including partitioning, schema evolution, and time travel.
  • Write large-scale batch and streaming transformations in PySpark or Spark SQL.
  • Write advanced SQL and production-grade Python across the platform.
  • Implement data governance, quality checks, and observability to catch issues before data consumers.

Skills

SQL
Python
Data governance

Tools

Amazon Redshift
Databricks
Apache Airflow
dbt
Fivetran
Airbyte
AWS DMS
Kafka/Kinesis
Apache Iceberg
Delta Lake
Hudi
PySpark
Spark SQL
Great Expectations
Monte Carlo
Terraform
Docker
GitHub Actions

Job description

We are hiring a Senior Data Engineer with 5+ years of experience to design, build, and operate a production data platform end to end. You will own ingestion, transformation, orchestration, and data quality on a modern cloud warehouse and lakehouse stack: Amazon Redshift or Databricks, Apache Airflow, dbt, and Apache Spark.

This is a hands-on role for someone who has run these systems in production and is accountable for their performance, cost, and reliability.

WHAT YOU'LL DO
  • Own data models and pipelines on Amazon Redshift or Databricks, including performance tuning, cost management, and workload isolation.
  • Author and operate Apache Airflow DAGs at scale, managing dependencies, retries, SLAs, and observability.
  • Build and maintain dbt transformations: model design, testing, macros, documentation, and CI/CD.
  • Develop and run ingestion pipelines using tools such as Fivetran, Airbyte, AWS DMS, Kafka/Kinesis, or custom CDC and API ingestion frameworks.
  • Manage lakehouse tables in open table formats (Apache Iceberg, Delta Lake, or Hudi), covering partitioning, schema evolution, compaction, and time travel.
  • Write large-scale batch and streaming transformations in PySpark or Spark SQL.
  • Write advanced, well-optimized SQL and production-grade Python across the platform.
  • Put data governance, quality checks, and observability in place so issues are caught before they reach data consumers.
REQUIRED QUALIFICATIONS

Candidates should demonstrate 5+ years of data engineering experience, with depth in:

  • Cloud data warehouse / lakehouse: Amazon Redshift or Databricks, with real production ownership of modeling, performance tuning, cost management, and workload isolation.
  • Apache Airflow: authoring and operating DAGs at scale, including dependency management, retries, SLAs, and observability.
  • dbt: model design, testing, macros, documentation, and CI/CD for transformations.
  • Data movement / ingestion tooling: for example Fivetran, Airbyte, AWS DMS, Kafka/Kinesis, or custom CDC and API ingestion frameworks.
  • Open table formats: Apache Iceberg, Delta Lake, or Hudi, including partitioning, schema evolution, compaction, and time travel.
  • Apache Spark: PySpark or Spark SQL for large-scale batch and streaming transformation.
  • SQL: advanced, including window functions and query optimization.
  • Data governance, quality, and observability: hands-on experience with tooling such as Great Expectations, Monte Carlo, or Elementary.
NICE TO HAVE
  • AWS ecosystem depth: S3, Glue, Lambda, IAM, and EMR.
  • Experience with streaming or near-real-time pipelines.
  • Infrastructure-as-code (Terraform), Docker, and CI/CD (GitHub Actions).
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Peyton Resource Group • Houston (TX)

On-site
USD 120,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
Senior Data Warehouse Engineer
Senior Data Warehouse Engineer

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Tredence Inc. • United States

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Zoominfo • United States

Remote
USD 110,000 - 170,000
Remote work
Sr. Data Engineer, Data Platform
Sr. Data Engineer, Data Platform

Mirion Technologies • United States

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Continuus Technologies LLC • Town of Germantown (WI)

On-site
USD 110,000 - 170,000
Senior Data Engineer
Senior Data Engineer

SRM Technologies LLC • United States

Remote
USD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Recru • Houston (TX)

On-site
USD 130,000 - 180,000
Data Engineer
Data Engineer

Advanced Tech Placement • Atlanta (GA)

On-site
USD 120,000 - 150,000