Cloud Dataflow Engineer/Analyst

Spatial Front, Inc.; Washington, Northern (District of Columbia, KY); Hybrid; USD 75,000 - 110,000; Full time

Benefits offered by this job

Comprehensive benefits package

Equal Opportunity Employer

Job summary

Spatial Front, Inc. (SFI) is seeking a Cloud Dataflow Engineer / Analyst to support a mission-critical data modernization initiative.

You will join the Dataflow Team to move high-volume, real-time datasets from legacy on-premise systems into a cloud platform with high availability. Over the next 6-12 months, you will focus on ingestion, automation, and reliability of real-time data streams to enable scalable data access, advanced analytics, and future AI/ML capabilities across hybrid

Qualifications

• Bachelor’s degree or equivalent experience in CS/IS or related field.
• 1–2 years hands-on cloud platform experience (AWS/Azure/GCP).
• 2+ years Linux/Unix administration or engineering support.
• Strong Python and Bash scripting; solid SQL and relational DB fundamentals.
• Experience supporting ETL pipelines, data integration, and automated CI/CD deployments.
• At least one foundational or associate-level cloud certification (e.g., AWS Cloud Practitioner).
• Ability to obtain and maintain a Public Trust clearance.

Responsibilities

• Execute large-scale data ingestion and migration from on-prem to cloud environments (AWS/Azure/GCP).
• Refactor legacy dataflow pipelines into automated, API-driven workflows using Python and Bash.
• Maintain and migrate legacy scripts to scalable, cloud-native solutions.
• Support 24/7 on-call rotation for mission-critical data flows.

Skills

Python

Bash

SQL

CI/CD

Cloud platforms

Linux

Education

Bachelor’s degree in Computer Science

Tools

Git

SVN

Job description

All Jobs > Cloud Dataflow Engineer/Analyst

Spatial Front, Inc. (SFI), a two-time USA Today Top Workplaces awardee and Washington Post Top Workplaces honoree, is seeking a Cloud Dataflow Engineer / Analyst to support a mission-critical enterprise data modernization initiative. In this role, you will join our Dataflow Team to serve as the critical operational bridge moving high-volume, real-time datasets from legacy on-premise infrastructure into a centralized, high-availability cloud platform.

Over the next 6-12 months, your primary focus will be supporting the ingestion, automation, and reliability of real-time data streams to power scalable data access, advanced scientific analytics, and future AI/ML capabilities across hybrid environments.

Key Responsibilities

• Execute and streamline large-scale data ingestion and migration processes from legacy on-premise systems to cloud environments (AWS/Azure/GCP).
• Transition legacy dataflow pipelines into automated, API-driven workflows using Python, Bash, and modern CI/CD practices.
• Maintain, refactor, and migrate legacy scripts and tools (Bash, Perl, SQL) to scalable, cloud-native solutions.
• This role offers a unique opportunity to learn the foundational legacy systems of the National Weather Service while simultaneously building the "Gold Standard" of cloud-based weather data dissemination.

Operations, Monitoring & Reliability

• Ensure continuous, low-latency delivery of mission-critical, high-volume data streams in a 24/7 operational environment.
• Monitor, troubleshoot, and optimize data routing applications, ingestion processes, and underlying cloud services.
• Serve as a Tier 2 technical escalation point for complex data ingestion, formatting, and delivery issues.
• Participate in a 24/7 on-call rotation to support mission-critical availability.

Data Lifecycle & System Integration

• Manage end-to-end data flow operations, including validation, quality control, archival, and retrieval.
• Collaborate with internal engineering teams and external stakeholders to resolve data access, formatting, and integration challenges.
• Author and maintain technical documentation, standard operating procedures (SOPs), and configuration standards.

Requirements

Education & Experience

• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience)
• Cloud Infrastructure: 1-2 years of hands-on experience with cloud platforms (AWS, Azure, or GCP).
• Linux Administration: 2+ years of Linux/Unix system administration or engineering support experience.
• Scripting & Databases: Strong proficiency in Python and Bash scripting, alongside solid SQL experience and relational database fundamentals.
• Pipelines & CI/CD: Demonstrated experience supporting ETL pipelines, data integration workflows, and automated CI/CD deployment tools.
• Certification: At least one (1) active foundational or associate-level cloud certification (e.g., AWS Certified Cloud Practitioner or equivalent).
• Ability to obtain and maintain a Public Trust clearance

Desired Skills & Qualifications

• Domain Expertise: Experience with scientific or meteorological data dissemination systems (NOAA, NASA, DoD) and familiarity with data formats such as METAR, TAF, GRIB, and BUFR.
• System Monitoring: Hands-on experience with monitoring tools (e.g., Big Brother, Nagios) or cloud-native monitoring solutions (e.g., AWS CloudWatch).
• Legacy Tools: Experience with Perl for legacy script migration.
• Version Control: Proficiency with Git, SVN, or similar version control tools.
• Advanced Certifications: Associate or Professional-level cloud engineering certifications

Additional Information:

• Clearance: Must be authorized to work in the U.S. and be able to obtain and keep a public trust clearance
• Background checks may include Criminal History, Education Verification, Employment Verification, Professional Certifications, and Credit History. Public Trust investigations typically take 4-8 weeks and require fingerprinting.
• Salary Range: $75,000 - $110,000 annually
• Benefits: SFI offers a comprehensive benefits package. Details available at SFI Careers.
• This is a full-time, W2 position.
• No agencies, third parties, or Corp-to-Corp submissions.
• Spatial Front Inc. is an Equal Opportunity Employer - all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or protected veteran status.