Senior Databricks Engineer: Delta Lake & AWS Data Platform

Robotics Technologies LLC

Pennsylvania

On-site

USD 92,000 - 131,000

Full time

3 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotics Technologies LLC in Malvern, PA seeks a Senior Databricks Developer with 7+ years of Data Engineering and deep Databricks, AWS, PySpark, Python, and SQL experience for building and supporting enterprise data pipelines.

You will design scalable ETL/ELT pipelines, implement Delta Lake and Medallion architectures, and optimize batch and streaming workloads on AWS; collaborating with engineers, architects, and analytics teams to deliver production-grade data platforms.

Qualifications

  • 7+ years of Data Engineering experience building enterprise-scale data platforms and pipelines.
  • 5+ years of hands-on Databricks development experience in production environments.
  • Strong expertise in Python, PySpark, and SQL with a focus on pipeline development.
  • Extensive experience developing and supporting data pipelines within AWS.
  • Strong knowledge of Delta Lake, Lakehouse Architecture, and Medallion Architecture (Bronze, Silver, Gold).
  • Hands-on experience with AWS services such as S3, Glue, Lambda, EMR, Redshift, Kinesis, IAM, and CloudWatch.
  • Deep understanding of Spark architecture, distributed data processing, performance tuning, partitioning, and optimization.
  • Experience building highly scalable batch and streaming data processing solutions.

Responsibilities

  • Design, develop, and maintain large-scale ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
  • Build scalable and highly reliable data ingestion, transformation, and orchestration frameworks within AWS.
  • Develop and support Delta Lake implementations and Medallion Architecture (Bronze, Silver, Gold) data pipelines.
  • Create and optimize batch and streaming pipelines that process large volumes of structured and unstructured data.
  • Leverage AWS services including S3, Glue, Lambda, EMR, IAM, EventBridge, CloudWatch, Kinesis, and Redshift to support end-to-end data workflows.
  • Optimize Spark jobs, Delta tables, and Databricks workloads for performance, scalability, and cost efficiency.
  • Partner with Data Engineers, Architects, Analytics teams, and business stakeholders to deliver high-quality data solutions.
  • Implement data quality controls, monitoring, alerting, and operational support processes.
  • Troubleshoot and resolve complex production issues across Databricks and AWS environments.
  • Contribute to engineering best practices, code reviews, automation, and platform modernization initiatives.

Skills

Databricks development
Python
PySpark
SQL
AWS data pipelines
Delta Lake
Medallion Architecture
Spark optimization
Data modeling

Tools

Databricks
S3
Glue
Lambda
EMR
Redshift
Kinesis
IAM
CloudWatch

Job description

Robotics Technologies LLC in Malvern, PA seeks a Senior Databricks Developer with 7+ years of Data Engineering and deep Databricks, AWS, PySpark, Python, and SQL experience for building and supporting enterprise data pipelines.

You will design scalable ETL/ELT pipelines, implement Delta Lake and Medallion architectures, and optimize batch and streaming workloads on AWS; collaborating with engineers, architects, and analytics teams to deliver production-grade data platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Engineer for Enterprise Data Pipelines
Senior Databricks Engineer for Enterprise Data Pipelines

Robotic Process Automation LLC • Pennsylvania

On-site
USD 95,000 - 128,000
Senior Databricks Engineer — Cloud Data Platform Lead
Senior Databricks Engineer — Cloud Data Platform Lead

Ethereum Technologies LLC • Pennsylvania

On-site
USD 112,000 - 128,000
Senior Databricks Data Engineer - Spark, AWS & Delta Lake
Senior Databricks Data Engineer - Spark, AWS & Delta Lake

Robotic Technologies Automation • Dallas (TX)

On-site
USD 140,000 - 180,000
Senior Databricks Engineer: Lakehouse, Delta Lake & AWS
Senior Databricks Engineer: Lakehouse, Delta Lake & AWS

Robotic Process Automation LLC • Wilmington (DE)

On-site
USD 90,000 - 128,000
Senior Databricks Engineer - Cloud Data Platform Leader
Senior Databricks Engineer - Cloud Data Platform Leader

Valiant Technologies LLC • Pennsylvania

On-site
USD 92,000 - 131,000
Senior Databricks Engineer – Data Platform Mastery
Senior Databricks Engineer – Data Platform Mastery

Quantum Technologies LLC • Pennsylvania

On-site
USD 96,000 - 131,000
Senior Data Engineer – Databricks & AWS Platform
Senior Data Engineer – Databricks & AWS Platform

Robotics Technologies LLC • Sunnyvale (CA)

On-site
USD 76,000 - 108,000
Senior Databricks Engineer - Delta Lake & ML Ops
Senior Databricks Engineer - Delta Lake & ML Ops

Long Finch Technologies, LLC. • Galena (OH)

On-site
USD 140,000 - 170,000
Senior Data Engineer: AWS DMS + Databricks
Senior Data Engineer: AWS DMS + Databricks

Robotics Technologies LLC • Wilmington (DE)

On-site
USD 120,000 - 180,000
Senior Databricks Developer
Senior Databricks Developer

Valiant Technologies LLC • Pennsylvania

On-site
USD 92,000 - 131,000