AI Solutions Architect

Bell Integration; Town of Florida (NY); On-site; USD 130,000 - 180,000; Full time

Job summary

Bell Integration is seeking an AI Solutions Architect to bridge technical capabilities with business needs. This generalist role analyzes customer requirements and designs AI solutions that deliver measurable business value across on-prem or cloud deployments.

The candidate will collaborate with Pre-Sales, contribute to RFPs, RFIs, SOWs, and run customer workshops, build rapid prototypes, and present demos of AI platforms. Strong knowledge of GPUs, containers, Kubernetes, and MLOps is expected.

Qualifications

• 5+ years of experience as a Solutions Architect.
• Hands-on experience with AI agents, RAG pipelines, and LLM inferencing.
• Experience on AI projects involving AI infrastructure, AI platforms, agentic AI, RAG, and MLOps.
• Experience writing high-level and low-level technical documentation for proposed solutions.
• Experience designing and running demos of AI solutions to internal and external audiences.
• Experience building and integrating simple prototypes using existing AI platforms and tools.
• Understanding of machine learning, deep learning, neural networks, and foundation models.
• Understanding of AI training and fine-tuning workflows, inference pipelines, and feature engineering.

Responsibilities

• Evaluate customer requirements and make architectural recommendations for AI implementations in on-prem or cloud environments.
• Provide best-practice guidance on architectural design across AI applications and projects.
• Propose technology solutions that extend beyond the core application when appropriate.
• Drive delivery by evaluating trade-offs, clarifying ambiguities, and ensuring scalable, reliable, secure, and highly available solutions.
• Support Pre-Sales in scoping, qualifying, and developing proposals and opportunities.
• Design and run demos of AI solutions for internal and external audiences.

Skills

AI agents

RAG pipelines

LLM inferencing

AI infrastructure

AI platforms

MLOps

Technical documentation

Demos & prototypes

ML foundations

Inference pipelines

Tools

Docker

Kubernetes

Prometheus

Grafana

Terraform

Git

CI/CD

Job description

We are looking for an AI Solutions Architect who would be responsible for bridging the gap between technical capabilities and business needs. This generalist role will require conducting in-depth analysis of customer requirements as well as designing AI solutions that drive business value. The ideal candidate is expected to have strong working knowledge of AI Infrastructure, Gen AI, Agentic Architecture, LLMs, RAG, and Machine Learning. Additionally, the candidate will also be required to provide technical support to the Pre-Sales team through collaboration in RFPs, RFIs, SOWs, as well as running customer workshops, building rapid prototypes, and presenting technical demos of various AI platforms and solutions to existing and potential customers.

• Evaluate customer requirements and make architectural recommendations for implementation, deployment and provisioning of AI solutions in on-prem or cloud environments.
• Provide best practice guidance on architectural design across multiple AI applications and projects.
• Propose technology solutions where appropriate that sit outside the core application.
• Drive delivery efforts by evaluating technical trade-offs, clarifying ambiguities and ensuring that solutions proposed are scalable, reliable, secure, and highly available.
• Support the Pre-Sales team in scoping, qualifying and developing proposals and opportunities.
• Experience:
• 5+ years of experience as a Solutions Architect.
• Hands-on experience with AI agents, RAG pipelines, and LLM inferencing.
• Experience working in AI projects involving at least three of the following domains: AI infrastructure, AI platforms, agentic AI, RAG, and MLOps.
• Experience writing high-level and low-level technical documentation for proposed solutions.
• Experience designing and running demos of AI solutions to internal and external audiences.
• Experience building and integrating simple prototypes using existing AI platforms and tools.
• Required skills:
• Understanding of machine learning, deep learning, neural networks, and foundation models.
• Understanding of AI training and fine-tuning workflows, inference pipelines, and feature engineering.
• Understanding of underlying infrastructure supporting AI workloads, such as GPUs, CPUs, spine/leaf and fat tree topologies, high speed interconnects, RoCE vs. InfiniBand, high speed shared storage, GPU-to-GPU and GPU-to-storage communications.
• Understanding of distributed systems requirements and design (scalability, availability, fault tolerance, reliability, consistency).
• Working knowledge of container fundamentals: container networking and storage volumes, as well as building and deploying Docker images.
• Working knowledge of various type of Operating Systems, such as Unix, Linux and Windows.
• Working knowledge with Kubernetes ecosystem using helm charts, operators, and container registries (i.e. Quay).
• Understanding of integration with observability and monitoring (Prometheus, Grafana) and logging.
• Understanding of vGPU, pass-through, MIG, or container-based GPU orchestration options.
• Familiarity with TensorFlow, PyTorch, Rapids, and other GPU-accelerated libraries.
• Familiarity with scripting, Python, Jupyter, Ansible, Terraform, Git, and CI/CD pipelines.
• High-level understanding of hypervisors like ESXi hosts and their management suites.
• High-level understanding of vSAN and VMFS/NFS datastores.
• High-level understanding of database types (SQL and NoSQL) and caching.
• High-level understanding various storage architectures (SAN, NAS, Object) to recommend the right platform for given workloads.
• High-level understanding of backup/restore, snapshots, and replication strategies aligned with RPO/RTO needs.
• High-level understanding of network fundamentals (VLAN, subnetting, DNS, etc.), L2 vs. L3 networks, routing protocols, and load balancing (F5, NGINX, MetalLB) HA and failover configurations.
• High-level understanding of firewalls, security policies, NAT, VPN tunnels, RBAC, TLS, PKI and certificates.

This position may require evening and weekend work for time-sensitive project implementations.

Protecting your privacy and the security of your data is a longstanding top priority for Bell Integration. Please consult our Privacy Notice ( click here) to know more about how we collect, use and transfer the personal data of our candidates.

For roles based in the US:

Bell is fully committed to being an Equal Opportunity Employer. We prohibit discrimination against any applicant or employee based on protected characteristics, or any other status protected by applicable federal, state, or local laws. Bell also considers qualified applicants with criminal histories in a manner consistent with applicable legal requirements. Bell participates in the E-Verify program to confirm employment eligibility and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S. We will only use E-Verify once you have accepted a job offer and completed the Form I-9. If E-Verify can’t confirm that you’re authorized to work, we will give you written instructions on how to resolve the issue. Please be advised that Bell may use artificial intelligence and machine learning technologies as part of its recruitment and hiring processes