Senior Databricks Engineer – Data Platform Mastery

Quantum Technologies LLC

Pennsylvania

On-site

USD 96,000 - 131,000

Full time

2 days ago

Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies. LLC is seeking a Senior Databricks Developer in Malvern, PA to design, build, and optimize enterprise-grade data pipelines using Databricks, PySpark, Python, and SQL.

You will work within AWS to deliver scalable, production-ready data platforms, applying Delta Lake and Medallion architectures. The role emphasizes hands-on engineering, with a focus on building robust ingestion, transformation, and orchestration solutions, monitoring, and operational support across large

Responsibilities

Design, develop, and maintain large-scale ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
Build scalable data ingestion, transformation, and orchestration frameworks within AWS.
Develop and support Delta Lake implementations and Medallion Architecture (Bronze, Silver, Gold) data pipelines.
Create and optimize batch and streaming pipelines processing large volumes of data.
Leverage AWS services (S3, Glue, Lambda, EMR, IAM, EventBridge, CloudWatch, Kinesis, Redshift) to support end-to-end data workflows.
Optimize Spark jobs, Delta tables, and Databricks workloads for performance and cost efficiency.
Partner with Data Engineers, Architects, Analytics teams, and stakeholders to deliver high-quality data solutions.
Implement data quality controls, monitoring, and operational support processes.
Troubleshoot production issues across Databricks and AWS environments.

Job description

Quantum Technologies. LLC is seeking a Senior Databricks Developer in Malvern, PA to design, build, and optimize enterprise-grade data pipelines using Databricks, PySpark, Python, and SQL.

Get your free, confidential resume review.

or drag and drop your file here.