Looking for an alternative to Microsoft Copilot in Word without recurring inference costs? Consider using llama.cpp with local LLMs directly within Microsoft Word. Llama.cpp is designed to facilitate LLM inference with minimal setup while delivering state-of-the-art performance across diverse hardware platforms, both locally and in the cloud. Its standout features include: Plain C/C++ implementation without any dependencies, Apple silicon is a first-class citizen and optimized via, Custom CUDA kernels for running LLMs on NVIDIA GPUs, CPU+GPU hybrid inference to partially accelerate models larger than the total VRAM capacity, etc.
To see how easily llama.cpp can be integrated into Microsoft Word without incurring additional costs, check out this demonstration video. The demo is powered by GPTLocalhost, which offers the same core features for individual use. LocPilot for Word is the Intranet edition of GPTLocalhost designed for enterprise users and team collaboration.
For more creative uses of local and private LLMs in Microsoft Word, explore additional demos available on our channel at @LocPilot. We hope this demonstration sparks new ideas and encourages you to create further applications that equip your team with cutting-edge on-premise AI capabilities. If you have any particular suggestions or concepts, please feel free to reach out to us at info@locpilot.com. Our mission is to make local AI more accessible and affordable for teamwork.