Senior Cloud Architect & DevOps Engineer – Weather Data

Roberts Recruiting, LLC; Boston (MA); On-site; USD 100,000 - 130,000; Full time

Job summary

A leading weather tech company based in Boston seeks a skilled DevOps Engineer to design and maintain a robust system for big data processing. This role requires extensive experience with Google Cloud Platform, Linux, and modern CI/CD practices. Candidates should have proficiency in Docker, Kubernetes, and an understanding of large-scale data processing platforms. Join a mission-driven team working to transform how weather data is accessed globally.

Qualifications

• Highly experienced with Google Cloud Platform.
• Fearless expert in Linux.
• Proficient with CI/Jenkins.
• Uses Terraform for automated provisioning.
• Utilizes Ansible for deployment.
• Familiar with Docker/Kubernetes.
• Understanding of big data processing platforms such as Apache Beam/Google Dataflow.

Responsibilities

• Architect and operate a reliable and efficient system for big data processing.
• Collaborate with algorithm development and data engineering teams.
• Improve current functionality and build upon it.

Skills

Google Cloud Platform

Linux expertise

CI/Jenkins

Terraform

Ansible

Docker/Kubernetes

Large-scale data processing platforms

Job description

We are a Boston-based weather tech company that provides high-resolution, low-latency weather forecasting tools to businesses and governments worldwide.

As a DevOps Engineer, you will help architect and operate a system for big data processing, data storage, and web and API delivery that is reliable, efficient, scalable, and secure. You will work closely with the algorithm development, data engineering, and frontend engineering teams to improve our current functionality and build on it.

We're trying to change how companies, governments, and individuals around the world see and adapt to weather, especially in places where there is little to no weather data currently available. To do that, we need to wrangle a complicated web of data sources, develop blazingly fast algorithms, and make sure that mission-critical data is where the user needs it, reliably.

We're looking for someone who:

• Is highly experienced with Google Cloud Platform
• Is a fearless Linux expert
• Uses CI/Jenkins
• Uses automated provisioning (Terraform) and deployment (Ansible)
• Uses Docker/Kubernetes
• Has an understanding of large-scale data processing platforms (Apache Beam/Google Dataflow, Spark/Google Dataproc)

It would be awesome if you had:

• Startup experience
• Experience with Python and/or Node
• Experience with APIs, caching, load balancing