intel / intel-extension-for-transformers Star 2.1k Code Issues Pull requests Discussions ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡ retrieval chatbot rag habana large-language-model chatpdf llm-inference 4-bits speculative-decoding llm-cpu streamingllm intel-optimized-llamacpp neural-chat neural-chat-7b autoround gaudi3 Updated Aug 26, 2024 Python
yas-sim / openvino-chatbot-rag-pdf Star 4 Code Issues Pull requests LLM Chatbot-RAG by OpenVINO. The chatbot can read a PDF file and answer to the related questions. python pdf chatbot llama rag openvino huggingface large-language-models llm retrieval-augmented-generation llama2 neural-chat Updated Jan 29, 2024 Python
yas-sim / openvino-llm-chatbot-rag Star 3 Code Issues Pull requests LLM chatbot example using OpenVINO with RAG (Retrieval Augmented Generation). natural-language-processing offline chatbot intel edge-computing rag openvino huggingface edge-inference cloud-free llm local-inference langchain dolly2 retrieval-augmented-generation llama2 neural-chat Updated Jan 25, 2024 Python