AnythingLLM
All-in-one private LLM and RAG desktop app for Mac, Windows, and Linux

Most popular alternative: Ask Your PDF (997 saves)
AnythingLLM is an all-in-one desktop application for Mac, Windows, and Linux that enables you to download and run any LLM locally and privately chat with your documents. By default, the LLM, embedding, and even vector database are all stored locally and can even run 100% offline.
If you are looking to leverage more powerful models, embedders, or vector databases you can connect to any of the 20+ integrated providers to supercharge your AnythingLLM instance.
Shipped with Ollama built-in, you do not need to download anything else to get a full RAG chatbot with zero setup and full privacy. Upload PDFs, mp3s, text files - Anything!
AnythingLLM also comes with a full developer API you can leverage for custom integrations and even several data source connectors like GitHub and YouTube.
AnythingLLM is an MIT Licensed project and is fully open-source for you to modify.
If you are looking for a multi-user experience AnythingLLM also has a self-hosted Docker image that supports concurrent users. AnythingLLM is the last RAG-based chatbot solution you will ever need.
If you are looking to leverage more powerful models, embedders, or vector databases you can connect to any of the 20+ integrated providers to supercharge your AnythingLLM instance.
Shipped with Ollama built-in, you do not need to download anything else to get a full RAG chatbot with zero setup and full privacy. Upload PDFs, mp3s, text files - Anything!
AnythingLLM also comes with a full developer API you can leverage for custom integrations and even several data source connectors like GitHub and YouTube.
AnythingLLM is an MIT Licensed project and is fully open-source for you to modify.
If you are looking for a multi-user experience AnythingLLM also has a self-hosted Docker image that supports concurrent users. AnythingLLM is the last RAG-based chatbot solution you will ever need.
Show more
Releases
Get notified when a new version of AnythingLLM is released
Notify me
February 16, 2024

Timothy Carambat
Initial release of AnythingLLM.
Pricing
Pricing model
Free
Paid options from
Free
Feature requests
4
votes
0 answers
Are you looking for a specific feature that's not present in AnythingLLM?
๐ก Request a feature
Prompts & Results
Add your own prompts and outputs to help others understand how to use this AI.
AnythingLLM was manually vetted by our editorial team and was first featured on February 15th 2024.
-
856,243641v1.6 released 21d agoFree + from $12/moReducing manual efforts in first-pass during code-review process helps speed up the "final check" before merging PRs
-
12,856101v2.1 released 2mo agoFree + from $45/moThis is the first AI marketing tool Iโve used that actually helps me get things done, not just suggest generic ideas. The mix of AI-powered strategy and real experts executing the work makes it feel like having a high-performance marketing team without the overhead
Pros and Cons
Pros
Supports multiple users
Privacy-focused design
Operable without internet
Compatible with various LLM
Supports diverse document formats
Customizable interface
Advanced developer API
Installable on any desktop
Compatible with MacOS and Windows
Allows user control
Supports enterprise models
Supports custom models
Supports open-source models
Standalone application capability
Internal and external operations
Plug-in-free operation
Any model, any document
One-click installation
Compatibility with GPT-4
Sky as limit customization
Operates with explicitly connected services
Doesnโt restrict LLM provider
Unlimited LLM control
Enterprise-ready tool
Comprehensive solution
Can function offline
Offers full control
Privacy-centered solution
Runs on machine without internet
Appearance customization
Diverse document support
View 26 more pros
Cons
No mobile compatibility
Requires explicit connectivity
No Linux support
Over-reliance on personal customization
Potential overload with diverse models
No multi-language support indicated
No automatic updates indicated
Limited document format support
View 3 more cons
7 alternatives to AnythingLLM for Document Q&A
-
Chat with your PDFs and extract valuable insights44,985997Released 2y agoFree + from $11.99/moNice interface, but no good at PDF answers, especially tables data.
-
Chat with any PDF instantly41,820634Released 2y agoFree + from $11.99/mo
-
AI that works with your documents25,670337Released 2y agoFree + from $6I have been using this application for some time now, and it pleasantly surprises me. At first, this tool seemed to be just something like a smart document search, but I was wrong. It is able to generate brief contents of books and documents. With it, I will be able to create my own knowledge base in various areas, which will be built only on the data I uploaded, which I am sure of. Overall, the app is great, and I can safely recommend it. How do I personally use this product: For example, to summarize medical research and books. I intend to use it for academic research to save time searching for answers to specific questions and searching for links (documents, pages, comments), and I have to say that I am impressed. I upload not only PDF documents, but also transcribe videos of specialists in the right subject and upload them together to the service. Thus, I make my personal library, knowledge base and the quality of knowledge deeper. More recently, I came up with the idea to use the knowledge of some specialists who run their social networks and tell me the information I am interested in on their pages, because I can also collect their posts on social networks. networks in one document and upload to the service. What I liked especially: 1. Simple and user-friendly interface. Everything is in its place and nothing superfluous. 2. The algorithm does not come up with answers, but proceeds from the data in the document, allowing you to ask contextual questions and receive point-to-point answers in real time. Very often, language models sin against this. 3. Unlimited questions in the "chat" You can ask as many questions as you want in real time without using any credits. 4. Unlimited daily download. 5. I can upload documents in any language and get answers in my own. I can make full use of knowledge from all over the world, not just in my language. 6. The file viewer and links work well. Just click on the link and you will open the document in exactly the right place! 7. Chat with documents is quite accurate and fast. 8. The idea of labels is quite convenient and it is possible to add multiple labels to a file. 9. After downloading the document, it will warn you which pages were not recognized or have little content. 10. Understands the context of the correspondence, and does not answer the last question. 11. Responsive support. 12. API Access 13. OCR. 14. Automation of the workflow. 15. The ability to use your OpenAI API key 16. There is a promising roadmap. Separately, I would like to tell you about the workflow automation function, with the help of, when working with a group of documents, which can be processed separately only the necessary sections of documents. This makes it possible to access several documents at once. This is a super opportunity to gain deeper knowledge from documents uploaded to the service. It should be noted that in the end, a lot depends on how correctly you ask the question. This is both a plus and a minus. An experienced user will always be able to bring the algorithm to the conclusions of interest. For novice researchers, it will be a little more difficult to set the right direction to find the right information. My dreams: 1. Although I have no problems with the document loading time, it would be cool to speed up the document processing time. 2. I would like more free language models. At the moment, the service uses OpenAL GPT 3.5 Turbo and Anthropic Claude 3 Haiku. In principle, this is enough, but it would be good if more advanced language models were included, which will allow you to study your documents even more deeply. 3. I would like to be able to add ready-made template queries to documents. 4. I would like to be able to mark the best answers, which I can quickly refer to later. 5. I would like to be able to create folders in the Documents and Options section cataloging my knowledge. 6. I would like to be able to change the title of the document. 7. I would like to have an internal search system for documents or labels, which will become very numerous over time. 8. It would be very useful to be able to add people to work together with configured access rights. 9. The opportunity to create your own knowledge base and post it on your website via html code would be very useful. 10. I would like to be able to highlight the desired fragment or keywords in the document when you click on the link in the response to the document request. What I wanted to draw attention to: It seemed to me that OCR does not work quite correctly, after downloading the document, it writes "you have not enough credits to use OCR", although there are credits. Maybe I was doing something wrong. I'll figure it out. In general, I would like to rate the usage experience at 5 stars. I recommend everyone to try it!
-
Creation of chatbots for messaging apps.17,700410Released 2y agoNo pricing
-
Chat your way through long documents instantly.17,169123Released 2y agoFree + from $1.99/mo
-
Chat with any PDF, ask questions, summarize and extract insights effortlessly.14,906109Released 1y agoFree + from $5/moThe maximum number of pdf pages for the free tier is 10, which is a bit small. Generally, I think people need this service for pdf documents over 50 pages or so.
-
Chat with your PDFs using AI13,59273Released 2y agoFree + from $12.99/mopoor support!!!, i have subscribed to their plan and has trouble using verifying my email, and no one on the support is responding its been week.
View 96 more alternatives
Q&A
What is AnythingLLM?
AnythingLLM is an AI business intelligence tool that provides a high degree of control for your Language Learning Model (LLM). It is designed for multi-user support for both internal and external operations, and it fully focuses on privacy, not communicating with any service without explicit connection. It is not tied to a single LLM provider and supports an array of models. This tool is also compatible with various document formats and has a customizable interface and developer API, allowing for a high level of personalization. It can function as a standalone application on your desktop, whether MacOS or Windows.
What is a Language Learning Model and how does AnythingLLM utilize it?
A Language Learning Model (LLM) is an artificial intelligence system designed for processing and understanding language-based data. AnythingLLM utilizes LLM by providing a utility that extends multi-user support and is geared towards both internal and external operations by maintaining privacy and compatibility with different types of LLM such as proprietary models, custom models, and open-source models.
How does AnythingLLM function without the internet?
AnythingLLM can function without internet connectivity as it operates with a privacy-focused design that only communicates with services that have been explicitly connected to it. This means it can run independently on your machine without the need for internet access.
What kind of models does AnythingLLM support?
AnythingLLM supports a wide variety of models. This includes but is not limited to proprietary enterprise models, tailored custom models, as well as open-source models.
What document formats does AnythingLLM handle besides PDFs?
Apart from PDFs, AnythingLLM also supports other diverse document formats including Word Documents. This broad range of document compatibility extends its utility in various operations.
Is AnythingLLM compatible with both MacOS and Windows operating systems?
Yes, AnythingLLM is compatible with both MacOS and Windows operating systems. It can be utilized as a standalone desktop application on these systems.
+ Show 14 more
Ask a question
If you liked AnythingLLM
Verified tools
-
10,216220v3.0 released 11mo agoFree + from $6.93/moI work with a large volume of documents. Documind is my salvation. The truly affordable price, speed, and quality of the chat result are impressive
-
90011Released 1y agoFree + from $9/mo
How would you rate AnythingLLM?
Help other people by letting them know if this AI was useful.