Software Engineer II - Software Engineering # 26-18445

US Tech Solutions; Urbandale (IA); On-site; USD 120,000 - 160,000; Full time

Job summary

US Tech Solutions is seeking a highly technical engineer to build and support weather data acquisition, processing, and analysis products using a cloud-based stack. The role targets both early and advanced career candidates capable of independent work in a fast-paced software delivery environment.

You will architect scalable backend systems ingesting terabytes to petabytes of weather data, implement infrastructure as code, and optimize cloud costs while collaborating with product management and

Qualifications

• Excellent coding skills in Python with production deployment experience.
• Experience with terabyte to petabyte data sources.
• Strong understanding of cloud computing, particularly AWS services (IAM, Lambda, S3, RDS).

Responsibilities

• Architect and propose AWS/Databricks solutions for large weather data ingestion, caching, and processing.
• Collaborate with product management to understand requirements and prioritize work.
• Build infrastructure as code (Terraform).
• Improve scalability and reduce cloud costs across pipelines.
• Develop REST APIs and backend processes for weather data using AWS Chalice/Lambda.
• Containerize and cache data using Docker and Redis; manage PostgreSQL/PostGIS databases.
• Support Databricks/Spark pipelines and data backfill into S3; perform SQL/PySpark analyses.
• Migrate CI/CD pipelines (GitHub Actions) and enhance monitoring (Datadog).
• Debug data issues and assist data scientists with large-scale data operations.

Skills

Python

Big data

AWS

Tools

Terraform

Docker

PostgreSQL

Databricks

Redis

GitHub Actions

Job description

Remote / Onsite (TBD) - Position is likely to start onsite and could transition to remote depending on level of performance.

Duration: 12 Months

Note

• Glider test currently being developed
• Remote / Onsite (TBD) - Position is likely to start onsite and could transition to remote depending on level of performance.

General Description:

We are looking for a highly technical engineer to build and support weather data acquisition, processing, and analysis products, including our weather service, using a cloud-based solutions stack. We are open to early or advanced career candidates with strong examples of Client contributions and highly independent work in a fast-paced software delivery environment.

Essential attributes/experience:

• Excellent coding skills (Python) with production software deployment experience
• Big data experience (terabyte or petabyte level data sources)
• Core understanding of cloud computing (e.g., AWS services like IAM, Lambda, S3, RDS)

Example Responsibilities (including but not limited to):

• Architect and propose new AWS/Databricks solutions & updates to existing backend systems that ingest, cache, and process terabyte and petabyte level weather data (e.g., from IBM Weather Company API)
• Work closely with the product management team and end users to understand customer experience and system requirements, build backlog, and prioritize work
• Build infrastructure as code (e.g., Terraform)
• Improve system scalability and optimize workflows to reduce cloud costs
• Create and update REST APIs and backend processes (e.g., AWS Chalice/Lambda) for current, historical, and forecast weather data
• Build/support solutions involving containerization (e.g., Docker), caching (Redis), and databases (e.g., PostgreSQL/PostGIS)
• Support Databricks/Spark pipelines for historical weather data backfill into S3 (Parquet/Delta Lake) and data analysis (SQL/PySpark)
• Migrate and maintain CI/CD pipelines (e.g., GitHub Actions)
• Enhance monitoring and alerting for weather systems (e.g., Datadog)
• Enable field testing and customer support operations by debugging and fixing data issues
• Work with data scientists to scalably fetch and manipulate large weather data sets for models and analysis

About US Tech Solutions:

US Tech Solutions is a global staff augmentation firm providing a wide range of talent on-demand and total workforce solutions. To know more about US Tech Solutions, please visit www.ustechsolutions.com.

US Tech Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

AI Statement:

By applying, you acknowledge that AI-assisted tools may be used during hiring.