RAG Engineer

MCI; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

MCI is seeking a highly skilled RAG Engineer to build Retrieval-Augmented Generation systems that fuse Large Language Models with enterprise data. You will develop scalable knowledge systems and AI solutions that deliver accurate, context-aware responses.

Join a tech-enabled BPO leader with a strong CX footprint, working on ingestion, indexing, vector search, and AI integration across cloud platforms. You will design pipelines, APIs, and governance for reliable knowledge access while advancing

Qualifications

• Bachelor's Degree in Computer Science, Information Systems, Data Science, AI, Software Engineering, or related field.
• 3+ years of experience in software/AI engineering, ML, or information retrieval.
• Strong proficiency in Python and production-grade application development.
• Experience building APIs, microservices, or cloud-native applications.
• Solid understanding of Large Language Models and Generative AI concepts.
• Experience designing and implementing Retrieval-Augmented Generation solutions.
• Understanding embeddings, vectorization, and semantic search methodologies.
• Experience with structured and unstructured data sources, and data ingestion/retrieval pipelines.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud.
• Strong analytical, troubleshooting, and communication skills.

Responsibilities

• Design and maintain Retrieval-Augmented Generation solutions providing accurate, context-aware responses.
• Build document ingestion, indexing, and retrieval pipelines.
• Develop enterprise knowledge repositories and search frameworks.
• Implement semantic search across structured and unstructured data.
• Design scalable architectures supporting AI-powered knowledge retrieval.
• Optimize retrieval performance and manage vector databases and embedding pipelines.
• Integrate retrieval systems with AI applications and develop APIs/services.
• Ensure governance, security, and operational excellence across RAG environments.
• Collaborate with AI engineers and product teams on solution design and delivery.
• Drive ongoing research and evaluate emerging retrieval frameworks and knowledge-management approaches.

Skills

Python

LLMs & Generative AI

AI/ML & information retrieval

APIs & microservices

RAG knowledge

Embeddings & semantic search

data ingestion, indexing, retrieval

Cloud platforms (AWS/AZURE/GCP)

communication & stakeholder engagement

Education

Bachelor's Degree in Computer Science or related field

Tools

Pinecone

Weaviate

Milvus

Chroma

LangChain

LlamaIndex

Haystack

Job description

MCI is one of the fastest-growing tech-enabled business services companies in the USA, with a strong call center footprint and operations that extend across multiple countries. We deliver Customer Experience (CX), Business Process Outsourcing (BPO), and Anything-as-a-Service (XaaS) cloud technology solutions across a wide range of industries, including healthcare, retail, government, education, telecom, technology e-commerce, and financial services. Our contact centers are powered by both on-site and remote agents, leveraging advanced technologies to enhance customer journeys, drive scalability and reduce costs.

At MCI we are committed to fostering an environment where professionals can build meaningful careers, access continuous learning and development opportunities and contribute to the success of a globally expanding, industry-leading organization.

Job Overview

We are looking for a highly skilled RAG Engineer to build Retrieval-Augmented Generation (RAG) systems that combine the power of Large Language Models with enterprise knowledge and information retrieval technologies. This role is focused on creating AI solutions that deliver accurate, context-aware responses by leveraging structured and unstructured organizational data.

You will play a key role in developing scalable knowledge systems that enhance AI reliability, trust, and business impact.

Key Responsibilities

Retrieval Architecture & Knowledge Systems

• Design and maintain Retrieval-Augmented Generation solutions that provide accurate and context-aware responses.
• Build document ingestion, indexing, and retrieval pipelines.
• Develop enterprise knowledge repositories and search frameworks.
• Implement semantic search capabilities across structured and unstructured data.
• Design scalable architectures supporting AI-powered knowledge retrieval.

Vector Search & Data Optimization

• Optimize retrieval performance and relevance across AI applications.
• Implement and manage vector databases and embedding pipelines.
• Improve retrieval quality through tuning and evaluation.
• Optimize latency, scalability, and search effectiveness.
• Maintain data quality and knowledge management standards.

AI Integration & Solution Delivery

• Support the integration of retrieval systems with AI applications.
• Collaborate with AI engineers and product teams on solution design.
• Integrate retrieval services with Large Language Models.
• Develop APIs and services that support AI workflows.
• Ensure reliable access to enterprise knowledge sources.

Monitoring, Governance & Security

• Maintain operational excellence across RAG environments.
• Monitor retrieval accuracy and system performance.
• Implement governance and data security controls.
• Troubleshoot retrieval and indexing issues.
• Maintain documentation and operational procedures.

Research & Innovation

• Drive continuous improvement in retrieval technologies and methodologies.
• Evaluate emerging retrieval frameworks and search technologies.
• Research new approaches to knowledge management and retrieval optimization.
• Recommend enhancements to improve user experience and AI performance.
• Contribute to AI architecture and innovation initiatives.

Ideal Candidates

• Bachelor's Degree in Computer Science, Information Systems, Data Science, Artificial Intelligence, Software Engineering, or a related field.
• Minimum 3 years of experience in software engineering, AI engineering, machine learning, or information retrieval.
• Strong proficiency in Python and experience developing production-grade applications.
• Experience building APIs, microservices, or cloud-native applications.
• Solid understanding of Large Language Models (LLMs) and Generative AI concepts.
• Experience designing and implementing Retrieval-Augmented Generation (RAG) solutions.
• Understanding of embeddings, vectorization techniques, and semantic search methodologies.
• Experience working with structured and unstructured data sources.
• Knowledge of data ingestion, indexing, and retrieval pipelines.
• Familiarity with cloud platforms such as AWS, Azure, or Google Cloud Platform.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and stakeholder engagement abilities.

Nice to Have

• Experience with Pinecone, Weaviate, Milvus, Chroma, or similar vector databases.
• Experience with LangChain, LlamaIndex, Haystack, or related frameworks.
• Knowledge of knowledge management and enterprise search platforms.
• Exposure to MLOps practices and AI deployment pipelines.
• Experience building conversational AI or chatbot solutions.
• Familiarity with containerization technologies such as Docker and Kubernetes.
• Understanding of AI governance, security, and compliance requirements.
• Experience working within Agile development environments.

This job operates in a professional office environment. While performing the duties of this job, the employee will be largely sedentary and will be required to sit/stand for long periods while using a computer and telephone headset. The employee will be regularly required to operate a computer and other office equipment, including a phone, copier, and printer. The employee may occasionally be required to move around the office to accomplish tasks; reach in any direction; raise or lower objects, move objects from place to place, hold onto objects, and move or exert force up to forty (40) pounds.

All MCI Locations

• Must be authorized to work in the country where the job is based.

Subject to the program and location of the position

• Must be willing to submit up to a LEVEL II background and/or security investigation with a fingerprint. Job offers are contingent on background/security investigation results.
• Must be willing to submit to drug screening. Job offers are contingent on drug screening results. (Does not apply in Canada)

Consistent with the Americans with Disabilities Act (ADA), it is the policy of MCI and its affiliates to provide reasonable accommodations when requested by a qualified applicant or employee with a disability unless such accommodations would cause undue hardship. The policy regarding requests for reasonable accommodation applies to all aspects of employment. If reasonable accommodations are needed, please contact Human Resources.

At MCI and its subsidiaries, we embrace differences and believe diversity is a benefit to our employees, our company, our customers, and our community. All aspects of employment at MCI are based solely on a person's merit and qualifications. MCI maintains a work environment free from discrimination, one where employees are treated with dignity and respect. All employees share in the responsibility for fulfilling MCI's commitment to a diverse and equal opportunity work environment.

MCI does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. MCI will consider for employment qualified applicants with criminal histories in a manner consistent with local and federal requirements.

MCI will not tolerate discrimination or harassment based on any of these characteristics. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of MCI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations, and ordinances where an employee works.

The purpose of the above job description is to provide potential candidates with a general overview of the role. It's not an all-inclusive list of the duties, responsibilities, skills, and qualifications required for the job. You may be asked by your supervisors or managers to perform other duties. You will be evaluated in part based upon your performance of the tasks listed in this job description.

The employer has the right to revise this job description at any time. This job description is not a contract for employment, and either you or the employer may terminate employment at any time, for any reason.