Senior Data Pipeline Engineer: AI & API Integration

VTG Defense; Herndon (VA); On-site; USD 180,000 - 230,000; Full time

Job summary

VTG Defense is seeking a Software Developer/Systems Engineer to design and maintain enterprise data feeds powering our security intelligence platforms. You will integrate data from 10+ vendor APIs, build robust ETL pipelines, and leverage AI for extraction and auto-healing.

The role requires active TS/SCI with Poly, 5+ years building production data pipelines in Python, and experience consuming REST APIs at scale. On-site in Herndon, VA with a competitive six-figure compensation.

Qualifications

• 5+ years building production data pipelines with Python.
• Proven experience consuming REST or similar APIs at scale.
• Familiarity with tools such as Nmap, Rapid7, or similar tools.
• Experience integrating AI with an application for efficient code responses.

Responsibilities

• Design and maintain enterprise data feeds from 10+ vendor APIs.
• Build intelligent parsers that handle diverse data formats.
• Orchestrate automated pipelines for regular data download, transformation and loading.
• Ensure reliability and performance through monitoring, error handling, and optimization.
• Adapt to change by quickly resolving API updates, data format changes, and vendor issues.
• Integrate AI capabilities for data extraction, classification, anomaly detection, and auto-healing.
• Perform technical evaluations of new tools for potential use and positive impact on project processes

Skills

Python

REST APIs

Data pipelines

AI integration

Tools

Nmap

Rapid7

Job description

VTG Defense is seeking a Software Developer/Systems Engineer to design and maintain enterprise data feeds powering our security intelligence platforms. You will integrate data from 10+ vendor APIs, build robust ETL pipelines, and leverage AI for extraction and auto-healing.

The role requires active TS/SCI with Poly, 5+ years building production data pipelines in Python, and experience consuming REST APIs at scale. On-site in Herndon, VA with a competitive six-figure compensation.