Data Operations Lead: Real-Time Data Pipelines & Analytics

Agile Defense, LLC; Tampa (FL); On-site; USD 140,000 - 190,000; Full time

Job summary

Agile Defense, LLC in the MacDill AFB area is seeking a Data Operations Technical Lead to architect and operate the foundational data infrastructure enabling AI-enabled analytics for SOF missions. This role requires Top Secret / SCI clearance to start and a strong background in data engineering for secure government programs.

You will design scalable ETL/ELT pipelines, real-time streaming, data models, and governance while mentoring junior engineers in a fast-paced, mission-focused environment,

Qualifications

• Active TS/SCI clearance is required to start.
• 8+ years of data engineering or software engineering experience with complex pipelines.
• Experience supporting SOF customers and enterprise data needs.

Responsibilities

• Design, build, and maintain scalable data pipelines (ETL/ELT) into data warehouses and data lakes.
• Collaborate with data scientists and analysts to understand data requirements and ensure data flow across platforms.
• Develop, deploy, and maintain real-time data streaming solutions (Kafka, Flink, Spark).
• Oversee data models and schemas for analytics-ready storage and fast access.
• Ensure data quality, integrity, and consistent data governance across systems.
• Monitor performance, troubleshoot bottlenecks, and optimize data processing workflows.
• Mentor junior data engineers and promote best practices.

Skills

TS/SCI clearance

Data operations leadership

ETL/ELT pipelines

Real-time streaming

Education

Bachelor's degree in CS/IS/Data Eng or related

Job description

Agile Defense, LLC in the MacDill AFB area is seeking a Data Operations Technical Lead to architect and operate the foundational data infrastructure enabling AI-enabled analytics for SOF missions. This role requires Top Secret / SCI clearance to start and a strong background in data engineering for secure government programs.

You will design scalable ETL/ELT pipelines, real-time streaming, data models, and governance while mentoring junior engineers in a fast-paced, mission-focused environment,