Senior Data Engineer: Lakehouse Pipelines & Data Quality

Taskus India

United States

A distancia

USD 140.000 - 190.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Taskus India is seeking a Senior Data Engineer to build resilient data systems and production-grade code that turns raw data into high-fidelity products. You will own pipelines from ingestion to transformation, ensure observability andcost-efficient operations, and collaborate with BI and Data Science teams to deliver feature-ready datasets.

You will leverage Python, SQL, PySpark, and a modern lakehouse stack (Databricks or Snowflake) with dbt, Airflow, and IaC.

Formación

  • 8+ years in data engineering and on-call readiness.
  • Expert Python, SQL and PySpark development.
  • Hands-on with Databricks (Delta Lake) or Snowflake and Medallion Architecture.
  • Proficient with dbt, CI/CD and modular, testable code.
  • Experience with Airflow or Prefect DAGs and orchestration.
  • Familiar with Kafka/Kinesis or Spark Streaming for real-time data.
  • IaC with Terraform or CloudFormation.
  • DuckDB for local development and testing, up to 100GB datasets.
  • Hybrid vs heavyweight compute trade-offs to optimize costs.

Responsabilidades

  • Own pipeline engineering: build/maintain high-throughput ETL/ELT pipelines into a lakehouse.
  • Drive code quality and tooling adoption (dbt, PySpark) with CI/CD.
  • Improve observability with data SLAs and monitoring for drift or failures.
  • Productize data: prepare feature-ready datasets with BI/Data Science teams.
  • Tune performance by analyzing SQL and Spark plans to reduce latency and cost.
  • Advocate local development using DuckDB to shorten iteration cycles.
  • Design cost-efficient micro-pipelines for client reporting and checks.
  • Explore embedded analytics and edge processing within local sites when bandwidth is limited.
  • Balance heavyweight vs lightweight compute for optimal workloads.

Conocimientos

Python
SQL
PySpark
Databricks
Snowflake
dbt
Apache Airflow
Kubernetes
Terraform
DuckDB
Kafka
Kinesis
Spark Streaming
Parquet/Iceberg

Herramientas

Databricks
Snowflake
dbt
Apache Airflow
Kubernetes
Terraform
DuckDB

Descripción del empleo

Taskus India is seeking a Senior Data Engineer to build resilient data systems and production-grade code that turns raw data into high-fidelity products. You will own pipelines from ingestion to transformation, ensure observability andcost-efficient operations, and collaborate with BI and Data Science teams to deliver feature-ready datasets.

You will leverage Python, SQL, PySpark, and a modern lakehouse stack (Databricks or Snowflake) with dbt, Airflow, and IaC.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Data Engineer: Architect Lakehouse Pipelines
Senior Data Engineer: Architect Lakehouse Pipelines

Dynata • EE. UU.

A distancia
USD 150.000 - 190.000
Senior Data Engineer: Production-Grade Lakehouse Pipelines
Senior Data Engineer: Production-Grade Lakehouse Pipelines

Aloola.io • Beverly Hills (CA)

Presencial
USD 150.000 - 230.000
Senior Data Engineer: Lakehouse + Cloud Data Pipelines
Senior Data Engineer: Lakehouse + Cloud Data Pipelines

FPT Asia Pacific • EE. UU.

A distancia
USD 140.000 - 190.000
Senior Data Engineer — AI-Driven Lakehouse & Pipelines
Senior Data Engineer — AI-Driven Lakehouse & Pipelines

TDIndustries, Inc. • Dallas (TX)

Presencial
USD 108.000 - 132.000
Senior Data Engineer: Databricks Lakehouse Pipelines
Senior Data Engineer: Databricks Lakehouse Pipelines

Bitful • EE. UU.

A distancia
USD 120.000 - 180.000
Senior Data Developer: Lakehouse Pipelines & Observability
Senior Data Developer: Lakehouse Pipelines & Observability

Ciandt • EE. UU.

A distancia
USD 120.000 - 180.000
Health and dental insurance
Meal and food allowance
Childcare assistance
+2
Senior Data Platform Engineer — Lakehouse & AI Pipelines
Senior Data Platform Engineer — Lakehouse & AI Pipelines

Tata Consultancy Services Limited • San Jose (CA)

Presencial
USD 80.000 - 115.000
Discretionary Annual Incentive
Medical Coverage
Parental Leaves
+2
Data Engineer: Scalable Pipelines, Lakehouse & Real-Time
Data Engineer: Scalable Pipelines, Lakehouse & Real-Time

EdgeQ Technologies Private Limited • EE. UU.

Presencial
USD 120.000 - 180.000
Senior Data Engineer: Databricks Lakehouse Leader
Senior Data Engineer: Databricks Lakehouse Leader

Tata Consultancy Services Limited • Irvine (CA)

Presencial
USD 120.000 - 180.000
Senior Data Engineer: Databricks Lakehouse & Pipelines
Senior Data Engineer: Databricks Lakehouse & Pipelines

Steampunk • McLean (VA)

Presencial
USD 140.000 - 180.000