Architect III - AI (IND)
Carelon Global Solutions India
Turn this role into an interview — a resume and cover letter built around what this employer wants.
Job summary
Carelon Global Solutions India is seeking an Architect-AI to lead end-to-end AI architecture efforts in Bangalore. The role focuses on building microservice-based AI platforms and scalable pipelines for enterprise deployments.
You will partner with data scientists, product managers, and DevOps to deliver robust AI solutions, optimize LLM inference, and implement MLOps practices. This is a full-time, on-site position with a strong emphasis on cloud-native design and governance.
Qualifications
- Bachelor's degree in Engineering or related field.
- Masters or PhD in data science or AI is a plus.
- Experience in AI architecture and cloud-native technologies.
Responsibilities
- Develop and maintain microservice architecture and API management for AI deployments.
- Design AI pipelines with predictive modelling and agentic frameworks.
- Collaborate with data scientists and product managers to manage data for ML models.
- Build scalable data pipelines to support AI/ML models.
- Implement CI/CD pipelines using GitHub Actions or Jenkins.
- Operate Kubernetes clusters for ML workloads with service mesh.
- Develop LLM inference architectures with quantization and GPU optimization.
- Engage in prompt engineering and fine-tuning of LLMs for semantic retrieval.
- Document architectures and experiments using MLflow or DVC.
- Research LLM optimization techniques to reduce costs.
- Collaborate with stakeholders to create NLP solutions like text classification and sentiment analysis.
- Conduct A/B tests and analyze results for improvements.
- Stay updated with AI trends and integrate new methodologies.
Skills
Education
Tools
Job description
Microservices LLM, Predictive modelling, Python, FastAPI, Vector DB(Qdrant, Chromadb, stc), RAG, MLOps & Deployment, Cloud, Agentic AI Framework, Kubernetes
Architect III - AI (IND)
IFT > IT Architecture
Architect -AI
Full-Time Employee
Bangalore
Architect
Delivery Manager
Microservices LLM, Predictive modelling, Python, FastAPI, Vector DB(Qdrant, Chromadb, stc), RAG, MLOps & Deployment, Cloud, Agentic AI Framework, Kubernetes
AI and Digital Platform
Super Super Niche
Elevance Health is a leading health company in America dedicated to improving lives and communities and making healthcare simpler. It is the largest managed health care company in the Blue Cross Blue Shield (BCBS) Association serving more than 45 million lives across 14 states.
A regular in Fortune 500 list, Elevance Health ranked 20 in 2022. Gail Boudreaux, President and CEO of Elevance Health has been a consistent name in the Fortune list of most powerful women and currently holds 4th rank on this list.
Carelon Global Solutions (CGS) is a healthcare solutions company that is simplifying complex operational processes to improve the health of the healthcare system.
Previously known as Legato Health Technologies, Carelon Global Solutions (hereinafter, CGS) underwent a name change and joined the Carelon family of brands in January 2023, as a fully owned subsidiary of Elevance Health ( Previously Anthem Inc.). CGS brings together a global team of like-minded innovators who manage and optimize operational processes for health plans as well as providers.
Our brightest minds housed across our global headquarters in Indianapolis as well as Bengaluru, Hyderabad and Gurugram in India, Manila in the Philippines, Limerick in Ireland and San Juan in Puerto Rico bring with them innovative capabilities and an unmatched depth of experience. This global team uniquely positions CGS to enable scalable, next-generation platforms and specialized digital tools that make healthcare operations more practical, effective and efficient.
Our Mission: Improving Lives and Communities. Simplifying Healthcare. Expecting More.
Our Values: Leadership | Community | Integrity | Agility | Diversity
Carelon Global Solutions India is seeking for a Architect-AI.
- Develop and maintain microservice architecture and API management solutions using REST and gRPC for seamless deployment of AI solutions.
- Design and implement AI pipelines using both predictive modelling and agentic framework.
- Collaborate with cross-functional teams, including data scientists and product managers, to acquire, process, and manage data for AI/ML model integration and optimization.
- Design and implement robust, scalable, and enterprise-grade data pipelines to support state-of-the-art AI/ML models.
- Debug, optimize, and enhance machine learning models, ensuring quality assurance and performance improvements.
- Familiarity with tools like Terraform, CloudFormation, and Pulumi for efficient infrastructure management.
- Create and manage CI/CD pipelines using Git-based platforms (e.g., GitHub Actions, Jenkins) to ensure streamlined development workflows.
- Operate container orchestration platforms like Kubernetes, with advanced configurations and service mesh implementations, for scalable ML workload deployments.
- Design and build scalable LLM inference architectures, employing GPU memory optimization techniques and model quantization for efficient deployment.
- Engage in advanced prompt engineering and fine-tuning of large language models (LLMs), focusing on semantic retrieval and chatbot development.
- Document model architectures, hyperparameter optimization experiments, and validation results using version control and experiment tracking tools like MLflow or DVC.
- Research and implement cutting-edge LLM optimization techniques, such as quantization and knowledge distillation, ensuring efficient model performance and reduced computational costs.
- Collaborate closely with stakeholders to develop innovative and effective natural language processing solutions, specializing in text classification, sentiment analysis, and topic modeling.
- Design and execute rigorous A/B tests for machine learning models, analyzing results to drive strategic improvements and decisions.
- Stay up-to-date with industry trends and advancements in AI technologies, integrating new methodologies and frameworks to continually enhance the AI engineering function.
- Contribute to creating specialized AI solutions in healthcare, leveraging domain-specific knowledge for task adaptation and deployment.
- Bachelor’s degree in any Engineering Stream
- Specialized training, certifications, and/or other special requirements: Nice to have
- Masters in data science or PHD is good to have
- Computer Science/Engineering.
Minimum relevant experience – 15+ Years in Datascience, GenAI in end to end architecture solution design
- Ability to understand availability metrics like 99.99% and architect systems that satisfy the required availability.
- Understanding of NFR (Non-Functional Requirements) with the ability to architect systems that meet NFR requirements such as availability, disaster recovery (DR), and an understanding of RTO (Recovery Time Objective) and RPO (Recovery Point Objective).
- Able to work on RFP (Request for Proposals) and RFI (Request for Information).
- Capability to define and create various architectures including technical, deployment, security, and functional overview.
- Proficiency in crafting As-Is and To-Be system architectures, along with authentication and authorization flows.
- Define strategies for scale-out and scale-up.
- Define and conduct load and stress testing, and define physical architecture.
- Develop logging strategies.
- Awareness of popular design frameworks such as SOLID.
- Familiarity with cloud architectural patterns.
- Ability to estimate effort for large program and define resource loading.
- Advanced proficiency in Python with expertise in data science libraries (NumPy, Pandas, scikit-learn) and deep learning frameworks (PyTorch, TensorFlow)
- Extensive experience with LLM frameworks (Hugging Face Transformers, LangChain) and prompt engineering techniques
- Experience with big data processing using Spark for large-scale data analytics
- Version control and experiment tracking using Git and MLflow
- Software Engineering & Development: Advanced proficiency in Python, familiarity with Go or Rust, expertise in microservices, test-driven development, and concurrency processing.
- DevOps & Infrastructure: Experience with Infrastructure as Code (Terraform, CloudFormation), CI/CD pipelines (GitHub Actions, Jenkins), and container orchestration (Kubernetes) with Helm and service mesh implementations.
- LLM Infrastructure & Deployment: Proficiency in LLM serving platforms such as vLLM and FastAPI, model quantization techniques, and vector database management.
- MLOps & Deployment: Utilization of containerization strategies for ML workloads, experience with model serving tools like TorchServe or TF Serving, and automated model retraining.
- Cloud & Infrastructure: Strong grasp of advanced cloud services (AWS, GCP, Azure) and network security for ML systems.
- LLM Project Experience: Expertise in developing chatbots, recommendation systems, translation services, and optimizing LLMs for performance and security.
- General Skills: Python, SQL, knowledge of machine learning frameworks (Hugging Face, TensorFlow, PyTorch), and experience with cloud platforms like AWS or GCP.
- Experience in creating LLD for the provided architecture.
- Experience working in microservices based architecture.
- Strong mathematical foundation in statistics, probability, linear algebra, and optimization
- Deep understanding of ML and LLM development lifecycle, including fine-tuning and evaluation
- Expertise in feature engineering, embedding optimization, and dimensionality reduction
- Advanced knowledge of A/B testing, experimental design, and statistical hypothesis testing
- Experience with RAG systems, vector databases, and semantic search implementation
- Proficiency in LLM optimization techniques including quantization and knowledge distillation
- Understanding of MLOps practices for model deployment and monitoring.
- Strong analytical thinking with ability to solve complex ML challenges
- Excellent communication skills for presenting technical findings to diverse audiences
- Experience translating business requirements into data science solutions
- Project management skills for coordinating ML experiments and deployments
- Strong collaboration abilities for working with cross-functional teams
- Dedication to staying current with latest ML research and best practices
- Ability to mentor and share knowledge with team members
Aligning with our brand belief of ‘limitless minds are our biggest asset’, we offer a world of limitless opportunities to our associates.
It is our strong belief that one is committed to a role when it is not just what the role entails, but also what lies in its periphery that completes the value circle for an associate.
This world of limitless opportunities thrives in an environment that fosters growth and well-being, and gives you purpose and the feeling of belonging.
- Extensive focus on learning and development
- An inspiring culture built on innovation, creativity, and freedom.
- Holistic well-being
- Comprehensive range of rewards and recognitions
- Competitive health and medical insurance coverage
- Best-in-class amenities and workspaces
- Policies designed with associates at the center.
Carelon is committed to a diverse and inclusive workplace and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics.
Our inclusive culture empowers Carelon to deliver the best results for our customers. We not only celebrate the diversity of our workforce, but we also celebrate the diverse ways we work.
If you have a disability and need accommodation such as an interpreter or a different interview format, please ask for the Reasonable Accommodation Request Form.
- Disclaimer: Offered designation titles differ.*
Full time
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
