Databricks Production Data Engineer - Remote (EST)

JobCubby; Northern (KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

JobCubby is seeking an experienced Databricks Data Engineer to support, maintain, and optimize Databricks-based data applications and pipelines. The role focuses on reliability, performance, and scalability of production Databricks workloads, working closely with data, analytics, and engineering teams to keep critical data applications stable and aligned with business needs.

You will monitor and improve pipelines, collaborate on enhancements, and ensure adherence to security and governance

Qualifications

• 6–9 years of data engineering experience.
• Strong hands-on Databricks experience.
• Proficiency in Apache Spark (PySpark/Scala) and SQL.
• Knowledge of Delta Lake concepts and optimizations.
• Experience with cloud platforms (Azure/AWS/GCP).

Responsibilities

• Maintain and optimize production Databricks workloads (jobs, notebooks, Delta Lake).
• Monitor, troubleshoot, and fix job failures and performance issues.
• Tune Spark queries and Delta tables for cost and reliability.
• Manage workspace configurations, clusters, and access controls.
• Implement data quality checks, logging, and basic observability.

Skills

Databricks

Spark

SQL

Delta Lake

ETL/ELT

Cloud platforms

Tools

Azure/AWS/GCP

Databricks Job clusters

Databricks Workflows

Unity Catalog

Job description

JobCubby is seeking an experienced Databricks Data Engineer to support, maintain, and optimize Databricks-based data applications and pipelines. The role focuses on reliability, performance, and scalability of production Databricks workloads, working closely with data, analytics, and engineering teams to keep critical data applications stable and aligned with business needs.

You will monitor and improve pipelines, collaborate on enhancements, and ensure adherence to security and governance