Weather Data Cloud Engineer — Big Data & AWS

US Tech Solutions; Urbandale (IA); On-site; USD 120,000 - 160,000; Full time

Job summary

US Tech Solutions is seeking a highly technical engineer to build and support weather data acquisition, processing, and analysis products using a cloud-based stack. The role targets both early and advanced career candidates capable of independent work in a fast-paced software delivery environment.

You will architect scalable backend systems ingesting terabytes to petabytes of weather data, implement infrastructure as code, and optimize cloud costs while collaborating with product management and

Qualifications

• Excellent coding skills in Python with production deployment experience.
• Experience with terabyte to petabyte data sources.
• Strong understanding of cloud computing, particularly AWS services (IAM, Lambda, S3, RDS).

Responsibilities

• Architect and propose AWS/Databricks solutions for large weather data ingestion, caching, and processing.
• Collaborate with product management to understand requirements and prioritize work.
• Build infrastructure as code (Terraform).
• Improve scalability and reduce cloud costs across pipelines.
• Develop REST APIs and backend processes for weather data using AWS Chalice/Lambda.
• Containerize and cache data using Docker and Redis; manage PostgreSQL/PostGIS databases.
• Support Databricks/Spark pipelines and data backfill into S3; perform SQL/PySpark analyses.
• Migrate CI/CD pipelines (GitHub Actions) and enhance monitoring (Datadog).
• Debug data issues and assist data scientists with large-scale data operations.

Skills

Python

Big data

AWS

Tools

Terraform

Docker

PostgreSQL

Databricks

Redis

GitHub Actions

Job description

US Tech Solutions is seeking a highly technical engineer to build and support weather data acquisition, processing, and analysis products using a cloud-based stack. The role targets both early and advanced career candidates capable of independent work in a fast-paced software delivery environment.

You will architect scalable backend systems ingesting terabytes to petabytes of weather data, implement infrastructure as code, and optimize cloud costs while collaborating with product management and