System/Solutions Architect

BayOne Solutions; India; On-site; INR 2,000,000 - 3,000,000; Full time

Job summary

A leading IT consulting firm is seeking a Systems or Solutions Architect to design scalable AI infrastructure. The ideal candidate has extensive experience in cloud architecture, networking, and automation, with a strong focus on AI/ML workloads. This full-time position is targeted at mid-senior level professionals. The role offers opportunities to lead innovative projects in a dynamic environment.

Qualifications

• 10+ years of experience in systems, infrastructure, or solutions architecture roles.
• Strong fundamentals in cloud architecture and networking.
• Proficiency with observability and automation tools.

Responsibilities

• Architect and scale AI/ML infrastructure across public cloud and hybrid environments.
• Design and optimize compute, storage, and network topologies.
• Collaborate with data science and ML Ops teams.

Skills

Cloud architecture expertise

Networking skills

Kubernetes experience

Automation with Python and Go

Monitoring and observability systems

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

AWS

Terraform

Prometheus

Grafana

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from BayOne Solutions

Connecting Ambitious Minds with Visionary Companies

About the Role

We are looking for a Systems or Solutions Architect with deep expertise in networking, infrastructure-as-a-service (IaaS), and cloud-scale system design to help architect and optimize AI/ML infrastructure.

The ideal candidate combines strong fundamentals in cloud architecture (AWS or equivalent), networking, compute, and storage, with hands‑on experience in Kubernetes, observability, and automation.

You’ll design scalable systems that support large AI workloads—enabling efficient training, inference, and data pipelines across distributed environments.

Key Responsibilities

• Architect and scale AI/ML infrastructure across public cloud (AWS / Azure / GCP) and hybrid environments.
• Design and optimize compute, storage, and network topologies for distributed training and inference clusters.
• Build and manage containerized environments using Kubernetes, Docker, and Helm.
• Develop automation frameworks for provisioning, scaling, and monitoring infrastructure using Python, Go, and IaC (Terraform / CloudFormation).
• Partner with data science and ML Ops teams to align AI infrastructure requirements (GPU/CPU scaling, caching, throughput, latency).
• Implement observability, logging, and tracing using Prometheus, Grafana, CloudWatch, or Open Telemetry.
• Drive networking automation (BGP, routing, load balancing, VPNs, service meshes) using software‑defined networking (SDN) and modern APIs.
• Lead performance, reliability, and cost‑optimization efforts for AI training and inference pipelines.
• Collaborate cross‑functionally with product, platform, and operations teams to ensure secure, performant, and resilient infrastructure.

Required Qualifications

• Knowledge of AI/ML infrastructure patterns, including distributed training, inference pipelines, and GPU orchestration.
• Bachelor’s or Master’s degree in Computer Science, Information Technology, or related field.
• 10+ years of experience in systems, infrastructure, or solutions architecture roles.

Deep Understanding Of:

• Cloud architecture: AWS (preferred), Azure, or GCP
• Networking: VPC, Transit Gateway, DNS, routing, peering, load balancing, VPN
• Compute and storage: EC2, ECS/EKS, S3, EBS, EFS, FSx, caching systems
• Core infrastructure: virtualization, containers, distributed systems, and OS‑level tuning
• Proficiency in Linux systems engineering and scripting with Python and Bash.
• Experience with Kubernetes (EKS/GKE/AKS) for large‑scale workload orchestration.
• Experience with Go (Golang) for infrastructure or network automation.
• Familiarity with Infrastructure‑as‑Code (IaC) tools like Terraform, Ansible, or CloudFormation.
• Experience implementing monitoring and observability systems (Prometheus, Grafana, ELK, Datadog, CloudWatch).

Preferred Qualifications

• Experience with DevOps and MLOps ecosystems (SageMaker, Kubeflow, MLflow, Airflow).
• AWS or cloud certifications such as Solutions Architect Professional or Advanced Networking Specialty.
• Experience in performance benchmarking, security hardening, and cost optimization for compute‑intensive workloads.
• Strong collaboration skills and ability to communicate complex infrastructure concepts clearly.

Seniority Level

Mid‑Senior level

Employment Type

Full‑time

Job Function

Engineering and Information Technology

Industries

IT Services and IT Consulting