Hybrid DataOps Engineer: Reliable, Self-Healing Pipelines

Enlighten; San Antonio (TX); Hybrid; USD 120,000 - 165,000; Full time

Benefits offered by this job

Health insurance

401(k) plan (10% benefit)

PTO + 10 holidays

Education/training allowances

Job summary

Enlighten, a Big Data leader, seeks a Data Operations Senior Engineer to lead a technically focused team responsible for reliability, uptime, and speed-to-delivery of mission-critical data sets. You will translate customer requirements into precise engineering workflows and ensure automated, well-documented pipelines aligned with client needs.

The role emphasizes moving from reactive fixes to an adaptive, self-healing platform, managing Flow Owners, and maintaining high-touch client

Qualifications

• Active Secret-level U.S. Government Security Clearance required.
• 9+ years in technical operations, systems engineering, or data management with a Bachelor’s degree; or 7+ years with a Master’s; or 13 years with a HS diploma.
• Experience with distributed messaging queues, data orchestration engines, and cloud-native storage.
• Strong observability and log-analysis skills for system health and latency reduction.
• Deep understanding of network data, metadata fill rates, and JSON/XML formats.
• Fluency in ETL processes enabling rapid analytics.
• SQL skills for data validation with team and customer.
• Ability to write automation scripts in Python or Java.
• Excellent written and verbal communication with non-technical stakeholders.
• Able to obtain Security+ certification within 60 days of hire.
• Hybrid work: 1–2 days/week in San Antonio, TX office.

Responsibilities

• Lead customer interface between client and technical team, translating data needs into tasks.
• Manage daily operations of the DataOps team to accelerate data availability.
• Oversee deployment and maintenance of data flows using templates and libraries.
• Tune cluster performance and monitor pipelines to minimize latency.
• Drive evolution of the data platform toward automated, self-healing operations.
• Coordinate ecosystem-wide sharing of scripts and flow strategies.
• Implement automated quality gates and schema validations before production.
• Troubleshoot complex dataflow issues across distributed environments.
• Perform other duties as assigned.

Skills

Distributed Systems

Observability

Data Standards

ETL Management

Data Validation

Scripting (Python/Java)

Technical Communication

Security Clearance

Education

Bachelor’s degree in related field

Master’s degree in related field

High School Diploma or equivalent

Job description

Enlighten, a Big Data leader, seeks a Data Operations Senior Engineer to lead a technically focused team responsible for reliability, uptime, and speed-to-delivery of mission-critical data sets. You will translate customer requirements into precise engineering workflows and ensure automated, well-documented pipelines aligned with client needs.

The role emphasizes moving from reactive fixes to an adaptive, self-healing platform, managing Flow Owners, and maintaining high-touch client