DevOps with GCP

MSRcosmos LLC; Atlanta (GA); On-site; USD 140,000 - 210,000; Full time

Job summary

MSRcosmos LLC seeks an experienced DevOps/Cloud Engineer to advance cloud-native AI/ML pipelines on Google Cloud. You’ll design scalable data infra, manage artifacts with JFrog Artifactory, and build secure, automated CI/CD loops across teams.

You will collaborate with Product, Data Science, and Infrastructure to deliver high-impact features, mentor junior engineers, and drive best practices in IAM, encryption, and cost optimization.

Qualifications

• 5+ years of DevOps or cloud engineering experience.
• Proficiency in Databricks and data engineering.
• Experience with CI/CD and GitOps methodologies; API development.
• Familiarity with JFrog Artifactory for artifacts and images.
• Experience designing and maintaining applications on Google Cloud (GKE, Cloud Run, serverless).
• Experience with GCP data services (BigQuery, Spanner, AlloyDB, Cloud Storage).
• Experience with event-driven systems (Pub/Sub, Kafka).
• Infrastructure as Code with Terraform.
• Knowledge of IAM, encryption, and security best practices in GCP.
• Repository management in Azure DevOps (ADO).

Responsibilities

• Develop LLM applications leveraging Google's Gemini API for language tasks.
• Design and implement scalable AI/ML pipelines using Databricks and Python.
• Develop cloud-native solutions on Google Cloud, using AlloyDB and CloudRun for persistence and containers.
• Build and optimize APIs with Google Cloud API Gateway; ensure security and monitoring.
• Establish DevOps and artifact management practices with JFrog Artifactory.
• Lead technical design reviews and provide mentorship to junior engineers.
• Implement CI/CD pipelines focusing on artifact management, versioning, and deployment automation.
• Collaborate with Product, Data Science, and Infrastructure teams to deliver features.

Skills

DevOps

Cloud engineering

Databricks

CI/CD

GitOps

GCP - GKE/Cloud Run/serverless

BigQuery/Spanner/AlloyDB/Cloud Storage

Pub/Sub/Kafka

Terraform

Data ingestion pipelines

IAM & security in GCP

ADO (Azure DevOps)

API development

Jfrog Artifactory

Tools

Jfrog Artifactory

Google Cloud API Gateway

Cloud Run

GKE

Terraform

Job description

5+ years experience in DevOps, Cloud engineering roles.

• Proficiency in Databricks
• Experience with CI/CD and GitOps methodologies, API development
• JFrog Artifactory
• Experience with design, developing and maintenance of applications on GCP (GKE, Cloud Run, and serverless architectures)
• Experience with GCP data services such as BigQuery, Spanner, AlloyDB, Cloud Storage)
• Experience with event-driven systems (Pub/Sub, Kafka)
• Experience with Infrastructure as Code (Terraform)
• Experience with data ingestion pipelines
• Understanding of IAM, encryption, and security best practices in GCP
• Repository management in ADO

Develop LLM applications leveraging Google's Gemini API for natural language understanding and generation

Design and implement scalable AI/ML pipelines using Databricks and Python, optimizing for performance and cost

Perform AI Engineering development, cloud-native solutions on Google Cloud, leveraging AlloyDB for data persistence and CloudRun for containerized services

Build and optimize APIs using Google Cloud API Gateway, ensuring security, rate limiting, and monitoring

Establish DevOps and artifact management practices using JFrog Artifactory for dependencies, build artifacts, and container images

Lead technical design reviews and architectural decisions, providing technical guidance and mentorship to junior engineers

Implement CI/CD pipelines with emphasis on build artifact management, versioning, and deployment automation

Collaborate with cross-functional teams (Product, Data Science, Infrastructure) to deliver high-impact features