Databricks Platform Operations Engineer

Scicom Infrastructure Services; Oregon; Hybrid; USD 120,000 - 180,000; Full time

Job summary

Scicom Infrastructure Services is seeking a Databricks Data Operations Specialist to ensure the stability, reliability, and security of a large Databricks data platform in a production environment.

You will monitor pipelines, respond to incidents, troubleshoot platform issues, coordinate deployments, and support data products across multiple data par-titions. The role requires hands-on experience with Spark, Delta Lake, Python, and cloud services.

Qualifications

• Bachelor's degree or equivalent in computer science, information technology, data engineering, information systems, or a related field (or equivalent professional experience).
• Hands-on experience supporting Databricks environments or production Databricks workloads.
• Experience with production ETL/ELT, batch, or streaming data pipelines.

Responsibilities

• Monitor the health, availability, performance, and capacity of Databricks workspaces, jobs, pipelines, clusters, SQL warehouses, and related cloud services.
• Provide day-to-day operational support for production Databricks environments.
• Monitor data pipelines for failures, data-quality issues, and performance degradation.
• Troubleshoot Databricks jobs, Spark workloads, cluster failures, notebook errors, connectivity issues, and data-processing exceptions.
• Coordinate deployments and remediation per documented procedures.
• Support Databricks Workflows, Delta Live Tables, Auto Loader, and streaming workloads.
• Review logs and metrics to identify root causes and improve reliability.
• Maintain runbooks and change-control procedures for production environments.

Skills

Analytical thinking

Organizational skills

Communication (written and verbal)

Troubleshooting

Cross-functional collaboration

Incident response

Education

Bachelor's degree or equivalent in CS/IT/Data Eng

Tools

Databricks

Apache Spark

PySpark / Python

SQL

Delta Lake

Databricks Workflows/Jobs

Cloud object storage

Monitoring & observability tools

Job description

Scicom Infrastructure Services is seeking a Databricks Data Operations Specialist to ensure the stability, reliability, and security of a large Databricks data platform in a production environment.

You will monitor pipelines, respond to incidents, troubleshoot platform issues, coordinate deployments, and support data products across multiple data par-titions. The role requires hands-on experience with Spark, Delta Lake, Python, and cloud services.