Senior DataOps Engineer - Remote

OpenKrill; United States; Remote; USD 130,000 - 180,000; Full time

Job summary

Oportun is seeking a Senior DataOps Engineer to operate, scale, and improve data platforms that support analytics, engineering, and business teams. The role emphasizes Databricks, AWS, data pipelines, observability, automation, and production support across multiple data services.

You will monitor pipelines, manage Databricks workspaces, support Unity Catalog, troubleshoot Spark and Delta Live Tables workloads, and build automation with Terraform and CI/CD pipelines.

Qualifications

• Strong experience supporting production data platforms, cloud infrastructure, or DataOps environments.
• Hands-on experience administering and supporting Databricks, including workspaces, jobs, workflows, compute, cluster policies, and access controls.
• Experience supporting Spark, Delta Lake, and Delta Live Tables workloads.
• Strong experience with AWS services such as EC2, VPC, IAM, S3, security groups, CloudWatch, and networking.
• Experience with infrastructure as code using Terraform and Terraform Enterprise or similar tools.
• Experience supporting MariaDB/MySQL and MongoDB in production environments.
• Strong understanding of monitoring, observability, alerting, and incident-management practices.
• Experience with CI/CD, Git, GitHub Actions, and automation using Bash, Python, PowerShell, or similar scripting languages.
• Experience troubleshooting platform performance, connectivity, permissions, certificates, TLS, and integration issues.
• Experience with production support, root-cause analysis, post-incident reviews, and on-call operations.
• Strong understanding of security and access concepts such as IAM, RBAC, secrets management, certificates, and secure connectivity.
• Strong communication and collaboration skills with the ability to work across Data Engineering, Analytics, Security, Infrastructure, Database, and application teams.

Responsibilities

• administer and support Databricks workspaces, cluster policies, compute configurations, jobs, workflows, libraries, service principals, permissions, and platform integrations.
• Support Unity Catalog, including access governance, catalog and schema permissions, and secure data sharing.
• Monitor and troubleshoot Delta Live Tables, Spark jobs, Delta Lake workloads, and data pipelines including failures, performance issues, recovery, and data-quality concerns.
• Maintain secure and reliable integrations between Databricks and AWS services, including S3, IAM, networking, VPC connectivity, and external data sources.
• Support AWS infrastructure used by the data platform, including EC2, VPC, IAM, security groups, networking, patching, and operational access.
• Support MariaDB/MySQL and MongoDB environments, including availability, monitoring, connectivity, backup coordination, performance troubleshooting, and recovery.
• Build and maintain monitoring, dashboards, logs, metrics, and alerts across Databricks, pipelines, databases, infrastructure, and integrations.
• Participate in on-call support and lead investigation, mitigation, recovery, communication, and root-cause analysis for production incidents.
• Build and maintain infrastructure and automation using Terraform, Terraform Enterprise, Git, GitHub Actions, CI/CD pipelines, and scripting.
• Automate repeatable operational activities such as provisioning, access configuration, monitoring deployment, recovery, and platform changes.

Skills

Databricks Admin

AWS services

Terraform

MariaDB/MySQL

MongoDB

CI/CD

Delta Live Tables

IAM RBAC

Incident mgmt

Tools

Databricks CLI

Databricks SQL

Job description

Oportun is seeking a Senior DataOps Engineer to operate, scale, and improve data platforms that support analytics, engineering, and business teams. The role emphasizes Databricks, AWS, data pipelines, observability, automation, and production support across multiple data services.

You will monitor pipelines, manage Databricks workspaces, support Unity Catalog, troubleshoot Spark and Delta Live Tables workloads, and build automation with Terraform and CI/CD pipelines.