Senior Data Engineer - Databricks & Delta Lake (Remote, ET)

TechShack

United States

Remote

USD 83,000 - 152,000

Full time

19 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

TechShack, a New York-based payments company, is seeking an experienced Data Engineer for a remote contract role. You will design, build and optimize scalable data pipelines on Databricks to support high-volume transaction processing, reporting and analytics in a regulated environment.

Working closely with analytics, product and engineering teams, you will implement Delta Lake architecture, batch and streaming ETL/ELT, and tune Spark jobs and AWS components. US Eastern Time hours apply.

Qualifications

  • 5+ years of hands-on Databricks experience.
  • Strong Python, PySpark and SQL skills.
  • Experience with Delta Lake, Unity Catalog and Databricks Workflows.
  • Strong AWS experience (S3, IAM, Glue, Lambda).
  • Experience building production-grade, high-volume data pipelines.
  • Based in the US and able to work Eastern Time hours.

Responsibilities

  • Design, build and maintain scalable data pipelines on Databricks.
  • Develop batch and streaming ETL/ELT workflows using PySpark and Spark SQL.
  • Implement and manage Delta Lake architecture with bronze, silver and gold layers.
  • Ensure data reliability, quality and governance across payment and transaction data.
  • Tune Spark jobs and Databricks clusters for performance and cost.
  • Collaborate with analytics, product and engineering stakeholders.

Skills

Databricks
Python
PySpark
SQL
Delta Lake
Unity Catalog
Databricks Workflows
AWS

Job description

TechShack, a New York-based payments company, is seeking an experienced Data Engineer for a remote contract role. You will design, build and optimize scalable data pipelines on Databricks to support high-volume transaction processing, reporting and analytics in a regulated environment.

Working closely with analytics, product and engineering teams, you will implement Delta Lake architecture, batch and streaming ETL/ELT, and tune Spark jobs and AWS components. US Eastern Time hours apply.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Databricks & Delta Lake (Remote)
Senior Data Engineer - Databricks & Delta Lake (Remote)

LorganTech • United States

Remote
USD 83,000 - 90,000
Remote Databricks Engineer — Delta Lake & ETL Expert
Remote Databricks Engineer — Delta Lake & ETL Expert

Arting Digital • United States

Remote
USD 120,000 - 180,000
Remote Databricks Engineer: Spark, Delta Lake & ETL
Remote Databricks Engineer: Spark, Delta Lake & ETL

Artingdigital • United States

Remote
USD 120,000 - 180,000
Remote Databricks Data Engineer - ETL/Delta Lake
Remote Databricks Data Engineer - ETL/Delta Lake

Randstad USA • Dallas (TX)

Remote
USD 67,000 - 69,000
Remote Databricks Engineer — Spark & Delta Lake Expert
Remote Databricks Engineer — Spark & Delta Lake Expert

Arting Digital Private Limited • United States

Remote
USD 120,000 - 170,000
Remote Databricks Data Architect - Lakehouse & Delta Expert
Remote Databricks Data Architect - Lakehouse & Delta Expert

Devoteam • United States

Remote
USD 110,000 - 160,000
Competitive salary
Annual bonus
Remote work
+1
Senior Databricks Data Engineer — Remote Contract
Senior Databricks Data Engineer — Remote Contract

Job Envoy • United States

Remote
USD 140,000 - 190,000
Fully remote in US
6-month+ contract option
Flexible start date
+2
Seniorn Data Engineer
Seniorn Data Engineer

TechShack • United States

Remote
USD 83,000 - 152,000
Senior Data Engineer - Databricks Lakehouse (Remote)
Senior Data Engineer - Databricks Lakehouse (Remote)

Stermedia • United States

Remote
USD 57,000 - 85,000
Flexible working hours
Remote work possible
Self-development budget
+2
Remote Databricks Data Engineering Lead
Remote Databricks Data Engineering Lead

Ethereum Technologies LLC • New Jersey

Remote
USD 84,000 - 120,000