IDF Dataflow Analyst

Spatial Front, Inc; Washington (District of Columbia); On-site; USD 65,000 - 100,000; Full time

Benefits offered by this job

Benefits package

Job summary

Spatial Front, Inc. is seeking an IDF Dataflow Analyst to support a large-scale data modernization initiative, migrating legacy on-premise systems into a centralized, high-availability cloud data platform.

This role is part of a Dataflow Team that serves as the critical bridge for the movement of real-time, high-volume data across a complex enterprise environment. Over the next 6–12 months, the primary focus will be on supporting the development and population of a centralized, real-time data

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience).
• 5–8 years of experience in a technical, data, or systems support role.
• 1–2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP).
• Strong scripting experience in Python and Bash (Perl experience a plus).
• Experience supporting data pipelines, ETL processes, or system integrations.
• Familiarity with CI/CD tools and automated workflows.
• Minimum 2 years of Linux/Unix system administration or support experience.
• Ability to obtain and maintain a Public Trust clearance.

Responsibilities

• Ingest and migrate large-scale datasets into a cloud-based data platform.
• Modernize legacy dataflow pipelines into automated, cloud-native solutions.
• Maintain high availability and reliability of real-time data delivery across hybrid environments.
• Monitor, troubleshoot, and optimize data ingestion and routing processes.
• Data lifecycle management including validation, archival, and retrieval.
• Support ingestion for mission-critical datasets into the cloud.
• Assist in transitioning workflows to API-driven and automated scripting (Python/Bash).
• Provide on-call support in a 24/7 rotation.
• Collaborate with internal teams and external partners to resolve data access and integration challenges.

Skills

Python

Bash

Perl

CI/CD

Linux/Unix

ETL

Data pipelines

Cloud platforms

Scripting

Education

Bachelor’s degree in Computer Science, Information Systems, or related field

Tools

Git

SVN

Big Brother

Nagios

CloudWatch

Job description

SFI is seeking an IDF Dataflow Analyst to support a large-scale data modernization initiative transitioning legacy, on-premise systems into a centralized, high-availability cloud data platform. This role is part of a Dataflow Team that serves as the critical bridge for the movement of real-time, high-volume data across a complex enterprise environment.

Over the next 6–12 months, the primary focus will be on supporting the development and population of a centralized, real-time data repository designed to enable scalable data access, advanced analytics, and future AI/ML capabilities.

Key Responsibilities

• Support the ingestion and migration of large-scale datasets into a cloud-based data platform
• Assist in modernizing legacy dataflow pipelines into automated, cloud-native solutions
• Maintain high availability and reliability of real-time data delivery across hybrid environments
• Monitor, troubleshoot, and optimize data ingestion and routing processes

Primary Responsibilities

• Data Lifecycle Management:
  Manage the end-to-end flow of real-time data, including validation, quality control, archival, and retrieval
• Cloud Data Ingest Support:
  Execute and support ingestion processes for mission-critical datasets into the cloud environment
• Pipeline Modernization:
  Assist in transitioning legacy workflows into API-driven and automated scripting solutions (Python/Bash)
• Operational Monitoring & Support:
  Ensure continuous data flow in a 24/7 environment; troubleshoot and resolve data delivery issues
• System Integration & Performance:
  Monitor and optimize data routing applications and cloud services to ensure performance and low latency
• Scripting & Maintenance:
  Maintain and enhance scripts and legacy tools (Bash, Perl, SQL) while supporting migration to modern solutions
• CI/CD & Automation:
  Support automated deployment, testing, and monitoring of dataflow applications and pipelines
• Tier 2 Support:
  Serve as a technical escalation point for complex data ingestion and formatting issues
• Documentation:
  Develop and maintain technical documentation, processes, and configuration standards
• On-Call Support:
  Participate in a 24/7 on-call rotation to support mission-critical operations
• Stakeholder Collaboration:
  Work with internal teams and external partners to resolve data access, formatting, and integration challenges

Requirements

Education & Experience

• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience)
• 5–8 years of experience in a technical, data, or systems support role
• 1–2 years of hands‑on experience with cloud platforms (AWS, Azure, or GCP)
• Strong scripting experience in Python and Bash (Perl experience a plus)
• Experience supporting data pipelines, ETL processes, or system integrations
• Familiarity with CI/CD tools and automated workflows
• Minimum 2 years of Linux/Unix system administration or support experience
• Ability to obtain and maintain a Public Trust clearance

Desired Skills & Qualifications

• Meteorological Domain Expertise: Experience working with scientific data dissemination and observation systems within NOAA, NASA, or Department of Defense environments; familiarity with standard meteorological data formats such as METAR, TAF, GRIB, and BUFR.
• System Monitoring: Hands‑on experience with enterprise monitoring tools, including Big Brother, Nagios, or cloud‑native solutions (e.g., Amazon CloudWatch) to ensure system performance, availability, and reliability.
• Database Management: Proficiency in SQL and a strong understanding of relational database design, querying, and maintenance.
• Version Control: Experience using version control and change management tools such as Git, Subversion (SVN), or similar platforms.

Certifications Required (one of the following)

• One foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent)
• Advanced cloud certifications

Additional Information:

• Clearance: Must be authorized to work in the U.S.
• Background checks may include Criminal History, Education Verification, Employment Verification, Professional Certifications, and Credit History. Public Trust investigations typically take 4–8 weeks and require fingerprinting.
• Salary Range: $65,000 – $100,000 annually
• Benefits: SFI offers a comprehensive benefits package. Details available at SFI Careers.
• This is a full-time, W2 position.
• No agencies, third parties, or Corp-to-Corp submissions.
• Spatial Front Inc. is an Equal Opportunity Employer — all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status.