Large File Inputs in AI Prompts

We are excited to announce the release of a new feature that allows users to input large files into the context or system prompt of an AI model. This innovative feature is designed to enhance the creation of conversational AI agents, and it's expected to reshape how developers utilize AI models.

The new feature provides a unique solution to adding more data into the backstory, a key part of ChatBotKit's AI model that describes the purpose of the bot and its behavior. The backstory, similar to the system or developer prompt in other AI models, becomes more versatile with this feature. It allows developers to insert a reference to a file, rather than pasting large amounts of text directly into the backstory.

A novel syntax starting with FILE_ followed by the ID or the name of the file is used to reference the file. This file can be as large as several megabytes, providing the bot with immediate access to more data. The bot is then able to use this data in subsequent interactions.

One of the key advantages of this feature is the potential for cost savings. The tokens in the file remain unchanged from the beginning, making the interactions with the model more cost-effective over time. Moreover, this feature could be creatively used as a database that can be continuously updated without altering the bot's original configuration.

We believe that this addition will significantly benefit developers and users alike, offering a more dynamic tool for creating AI agents. We are keen to see how this new feature will be utilized in various creative ways and we are eagerly awaiting feedback from our user community.

For more information how to use feature checkout the How to Insert a Large Files into the Backstory tutorial.