Candy: Bites of Knowledge
The Magic of Candies
Candies are user-created “bites of knowledge” that enhance characters with extensive information and immersive instructions on mannerisms and speech. These candies enable realistic characters, large knowledge bases, and effectively infinite, meaningful conversations by allowing characters to intelligently access information beyond the context limit of an LLM.
Functionality
Users can create and share candies containing vast amounts of data, applying them to new and existing characters to personalize and enhance interactions. There is no limit to the number of candies that can be attached to a character, allowing for endless customization.
At launch, candies support text, images, and links to media on platforms like YouTube and Spotify. As the Toffee platform evolves, this will include other modalities such as video and audio.
Why are they needed?
Candies address common issues in conversational AI, such as context limitations and hallucination, through Retrieval-Augmented Generation (RAG). Instead of placing the entire conversation history and knowledge base into the context window of an LLM, Toffee intelligently includes only the most relevant information for each query, reducing the cost of inference and enabling larger knowledge bases. As Toffee advances the efficacy of RAG, interactions become increasingly relevant, accurate, and immersive. Learn More.
Building the future of artificial intelligence through decentralization.
© 2024 VectorChat. All right reserved
