Large language models (LLMs) have been rapidly advancing over the past few years. While bigger and more powerful versions are being developed in the cloud, there’s a growing trend towards running LLMs on your own computer. This shift aims to bring LLMs closer to your device, providing faster and completely private processing of your data. By doing so, you can unlock new possibilities for your writing and reduce costs associated with cloud-based solutions such as Microsoft Copilot in Word.
After conducting research on affordable alternatives at Microsoft AppSource, we discovered several promising Word Add-ins that caught our attention. Add-ins like Ghostwriter, GPT for Word, and Sakti GPT, as well as GenText AI Assistant, offered useful features. However, upon closer inspection, we realized that all of these options are cloud-based, which raised concerns about data privacy and flexibility. We needed a solution that could meet our specific requirements without relying on the cloud. Ultimately, we decided to create a local Word Add-in tailored to our unique needs.
A local Word Add-in is made possible by leveraging the developer mode provided by Microsoft during software development. In this way, before production run, developers can work on the source code and test it locally . This developer mode enables access to local resources that wouldn’t be available if the Add-in were cloud-based at Microsoft AppSource. Today, many powerful LLMs are widely used locally. However, one significant limitation is that they cannot be seamlessly utilized in Microsoft Word.
The local Word Add-in here is called LocPilot for Word, which has been successfully integrated with several popular local LLM Servers or Gateways, such as AnythingLLM , LiteLLM, LM Studio, Ollama, llama.cpp, LocalAI, KoboldCpp, and Xinference. Using the intuitive interface as shown below, you can easily customize your experience by selecting a text range as the input prompt (e.g., the whole document), choosing where to output the generated response (e.g., the end of the document), and providing instructions for the model to follow (e.g., complete the writing). With LocPilot for Word, you can take advantage of these powerful LLM servers to enhance your productivity and creativity within Microsoft Word completely locally.
For maximum flexibility and simplicity, we don’t include LLM servers during installation. You can stick with your existing LLM server or install a new one. As long as it is compatible with the API spec for chat completion defined by OpenAI, it will work with LocPilot for Word. If you encountered any issues connecting to a different LLM server, please email info@locpilot.com.
At LocPilot for Word, we are changing the way AI is experienced by leveraging advanced LLMs on your local device. Your data never leaves your device. It stays just with you. We envision a future where AI is accessible, secure, and efficient for everyone — without compromising privacy or performance. For answers to common questions, check our FAQ section or reach out to us with any questions you may have. Start your free trial today! Download LocPilot for Word now and experience its features firsthand.
Here’s a quick demo. The demo is powered by GPTLocalhost, which offers the same core features for individual use. LocPilot for Word is the Intranet edition of GPTLocalhost designed for enterprise users and team collaboration.
For more creative uses of local and private LLMs in Microsoft Word, explore additional demos available on our channel at @LocPilot. We hope this demonstration sparks new ideas and encourages you to create further applications that equip your team with cutting-edge on-premise AI capabilities. If you have any particular suggestions or concepts, please feel free to reach out to us at info@locpilot.com. Our mission is to make local AI more accessible and affordable for teamwork.