Senior AWS DataOps Engineer – Databricks & Data Pipelines

UST; San Antonio (TX); On-site; USD 96,000 - 117,000; Full time

Benefits offered by this job

401(k) with employer matching

Medical, dental, and vision insurance

Paid time off

HSA and FSA options

Employee assistance program

Job summary

UST is seeking a Senior DataOps AWS Support Engineer to ensure operational stability and continuous improvement of AWS-based data workloads. You will monitor, troubleshoot, and optimize Databricks and APIHUB services, while managing data integrity and access control across multiple environments.

The role demands hands-on experience with Databricks, AWS services, SQL, and incident management. You will engage with engineering, business, and vendor teams, and participate in on-call rotations in a

Qualifications

• 5+ years of experience in data ops, AWS data workloads, or cloud-native applications.
• Hands-on experience with Databricks including workflows, clusters, notebooks, and Delta tables.
• Strong SQL skills and ability to investigate data issues directly in analytics platforms.
• Experience with incident management, triage, root-cause analysis, and post-incident actions.

Responsibilities

• Provide production support for AWS DataOps workloads across Databricks StoreOps and APIHUB.
• Monitor Databricks jobs, workflows, clusters, notebooks, Delta tables, Unity Catalog assets, and data-access controls.
• Support AWS data-lake services (S3, IAM, CloudWatch) and account-level access patterns.
• Troubleshoot failed jobs, delayed loads, data freshness issues, and pipeline interruptions.
• Support APIHUB services, including FastAPI or REST endpoints and OpenSearch indexes.
• Investigate ingestion and integration issues involving Kafka, Confluent Cloud, and cross-cloud data flows.
• Perform first-response triage, incident coordination, and escalation for high-priority issues.
• Use logs, SQL analysis, CloudWatch, Datadog, and service metrics to isolate failures.
• Validate data completeness, freshness, and downstream availability.
• Assist with access requests for AWS accounts, Databricks workspaces, and governed datasets.

Skills

AWS

SQL

FastAPI

Databricks

OpenSearch

Python

CI/CD

Tools

Databricks

Kafka

Terraform

Job description

UST is seeking a Senior DataOps AWS Support Engineer to ensure operational stability and continuous improvement of AWS-based data workloads. You will monitor, troubleshoot, and optimize Databricks and APIHUB services, while managing data integrity and access control across multiple environments.

The role demands hands-on experience with Databricks, AWS services, SQL, and incident management. You will engage with engineering, business, and vendor teams, and participate in on-call rotations in a