Data Operations Technical Lead

Agile Defense; Tampa (FL); On-site; USD 100,000 - 130,000; Full time

Job summary

Agile Defense is seeking a Data Operations Technical Lead based in MacDill AFB, FL. This role requires designing, building, and maintaining efficient data pipelines while ensuring data quality and managing resources effectively. Candidates should have a Bachelor's degree in Computer Science and at least 5 years of experience in data engineering. An active TS/SCI clearance is essential.

The candidate will mentor junior engineers and stay updated on industry best practices, enhancing the data infrastructure of the organization.

Qualifications

• 5+ years of experience in data engineering or software engineering.
• Experience in designing and managing complex data pipelines.
• Active TS/SCI clearance required.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Collaborate with data scientists to ensure data flow.
• Implement data quality and validation mechanisms.
• Mentor junior data engineers and promote best practices.

Skills

Data infrastructure management

Data quality assurance

Project management

Data engineering

Education

Bachelor's degree in Computer Science or related field

Master's degree preferred

Tools

Apache Kafka

Flink

Spark Streaming

Job description

Job Details

Requisition #: 1700

Job Title: Data Operations Technical Lead

Location: MacDill AFB, FL

Clearance Level: Top Secret / SCI, Must Have Clearance to Start

Job Description

• Design, build, and maintain highly scalable, reliable, and efficient data pipelines for extracting, transforming, and loading (ETL/ELT) data from various sources into data warehouses, data lakes, and other storage systems.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the efficient flow of data across various platforms and systems.
• Develop, deploy, and maintain real-time data streaming solutions to process and deliver data with low latency (using tools like Apache Kafka, Flink, or Spark Streaming). Optimize and automate data workflows, ensuring that data pipelines are efficient, reliable, and capable of handling increasing data volumes. Oversee the development of data models and schema designs to ensure accurate, accessible, and high-performance data storage for analytics and reporting.
• Ensure data quality, integrity, and consistency by implementing data validation, monitoring, and error-handling mechanisms.
• Monitor and troubleshoot performance bottlenecks in data systems, resolving issues with data processing and data access.
• Stay current with emerging trends and best practices in data engineering, recommending new tools, technologies, and methods to enhance existing infrastructure.
• Mentor and guide junior data engineers, promoting best practices in data engineering and fostering a collaborative, high-performance team environment.

Education and Background

Typically has a Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related field (master's degree preferred) and 5+ years of experience in data engineering or software engineering, with demonstrated experience in designing and managing complex data pipelines, or equivalent relevant work experience; e.g., each year of work experience may be substituted for each year of education required.

Years of Experience

5+ years

Required Skills

• The contractor shall identify a Data Operations Technical Lead by name who shall deliver the foundational data infrastructure necessary to transform SOF Enterprise data into a critical strategic asset. This individual will ensure comprehensive data and engineering management, data quality and resource management providing scalable systems and reliable infrastructure essential for integrating advanced analytics and effective Artificial Intelligence solutions, significantly enhancing data-driving decision-making across all warfighting functions.
• Have active TS/SCI clearance
• Minimum of 5 years’ experience managing digital projects in support of SOF Enterprise customers

Preferred Skills

• Three years experience managing SOF agile development processes
• Three years experience managing SOF Data Operations processes and procedures
• Three years experience managing SOF digital support request requirements, translating them from customer requests to assigning customer and digital support teams

Working Conditions

General Office Environment

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities