8c39e20e · permissionBRICK/SillyTavern

.github/readme-ja_jp.md+17 -3 Viewed

 > [!IMPORTANT]
 > ここに掲載されている情報は、古かったり不完全であったりする可能性があります。最新の情報は英語版をご利用ください。
 +![][cover]
++
 +<div align="center">
++
 [English](readme.md) | [中文](readme-zh_cn.md) | 日本語 | [Русский](readme-ru_ru.md)
 -![SillyTavern-Banner](https://github.com/SillyTavern/SillyTavern/assets/18619528/c2be4c3f-aada-4f64-87a3-ae35a68b61a4)
 +[![GitHub Stars](https://img.shields.io/github/stars/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/stargazers)
 +[![GitHub Forks](https://img.shields.io/github/forks/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/network)
 +[![GitHub Issues](https://img.shields.io/github/issues/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/issues)
 +[![GitHub Pull Requests](https://img.shields.io/github/issues-pr/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/pulls)
++
 +</div>
++
 +---
 モバイルデバイスにも適したレイアウト・マルチAPI（KoboldAI/CPP、Horde、NovelAI、Ooba、OpenAI、OpenRouter、Claude、Scale）、VN ライクな Waifu モード、Stable Diffusion、TTS、WorldInfo（伝承本）、カスタマイズ可能なUI、自動翻訳、大量のプロンプトオプション＋サードパーティの拡張機能をインストールする機能

 ## スクリーンショット
 <img width="400500" alt="image" src="https://user-images.githubusercontentgithub.com/18619528/228649245user-8061c60fattachments/assets/9b5f32f0-63dcc3b3-488e4102-9325b3f5-f151b7a3ec2d.png0e9213c0f50f">
 <img width="400500" alt="image" src="https://user-images.githubusercontentgithub.com/18619528/228649856user-fbdeef05attachments/assets/913fdbaa-d7277d33-4d5a42f1-be80ae2c-266cbbc6b811.png89dca41c53d1">
 ## ライセンスとクレジット

 * @doloroushyeonse による韓国語翻訳
 * k_euler_a による Horde のサポート <https://github.com/Teashrock>
 * [@XXpE3](https://github.com/XXpE3) による中国語翻訳、中国語 ISSUES の連絡先は @XXpE3
++
 +<!-- LINK GROUP -->
 +[cover]: https://github.com/user-attachments/assets/01a6ae9a-16aa-45f2-8bff-32b5dc587e44

.github/readme-ru_ru.md+15 -4 Viewed

 <a name="readme-top"></a>
 +![][cover]
++
 +<div align="center">
++
 [English](readme.md) | [中文](readme-zh_cn.md) | [日本語](readme-ja_jp.md) | Русский
 -![][cover]
 +[![GitHub Stars](https://img.shields.io/github/stars/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/stargazers)
 +[![GitHub Forks](https://img.shields.io/github/forks/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/network)
 +[![GitHub Issues](https://img.shields.io/github/issues/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/issues)
 +[![GitHub Pull Requests](https://img.shields.io/github/issues-pr/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/pulls)
++
 +</div>
++
 +---
 Мобайл-френдли интерфейс, поддержка множества API (KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI, OpenRouter, Claude, Scale), ВН-образный режим Вайфу, Stable Diffusion, TTS, поддержка миров (лорбуков), кастомизируемый UI, автоперевод, тончайшая настройка промптов + возможность устанавливать расширения.

 ## Скриншоты
 <img width="400500" alt="image" src="https://github.com/SillyTavern/SillyTavernuser-attachments/assets/61471128/e902c7a29b5f32f0-45a6c3b3-44154102-97aab3f5-c59c597669c10e9213c0f50f">
 <img width="400500" alt="image" src="https://github.com/SillyTavern/SillyTavernuser-attachments/assets/61471128/f8a79c47913fdbaa-4fe97d33-456442f1-9e4aae2c-bf247ed1c96189dca41c53d1">
 ### Ветки

 <!-- LINK GROUP -->
 [back-to-top]: https://img.shields.io/badge/-BACK_TO_TOP-151515?style=flat-square
 [cover]: https://github.com/SillyTavern/SillyTavernuser-attachments/assets/18619528/c2be4c3f01a6ae9a-aada16aa-4f6445f2-87a38bff-ae35a68b61a432b5dc587e44
 [discord-link]: https://discord.gg/sillytavern
 [discord-shield]: https://img.shields.io/discord/1100685673633153084?color=5865F2&label=discord&labelColor=black&logo=discord&logoColor=white&style=flat-square
 [discord-shield-badge]: https://img.shields.io/discord/1100685673633153084?color=5865F2&label=discord&labelColor=black&logo=discord&logoColor=white&style=for-the-badge

.github/readme-zh_cn.md+17 -3 Viewed

 > [!IMPORTANT]
 > 这里的信息可能已经过时或不完整，仅供您参考。请使用英文版本获取最新信息。
 +![][cover]
++
 +<div align="center">
++
 [English](readme.md) | 中文 | [日本語](readme-ja_jp.md) | [Русский](readme-ru_ru.md)
 -![image](https://github.com/SillyTavern/SillyTavern/assets/18619528/c2be4c3f-aada-4f64-87a3-ae35a68b61a4)
 +[![GitHub Stars](https://img.shields.io/github/stars/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/stargazers)
 +[![GitHub Forks](https://img.shields.io/github/forks/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/network)
 +[![GitHub Issues](https://img.shields.io/github/issues/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/issues)
 +[![GitHub Pull Requests](https://img.shields.io/github/issues-pr/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/pulls)
++
 +</div>
++
 +---
 移动设备界面友好，多种人工智能服务或模型支持（KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI, OpenRouter, Claude, Scale），类似 Galgame 的 老 婆 模 式，Horde SD，文本系统语音生成，世界信息（Lorebooks），可定制的界面，自动翻译，和比你所需要的更多的 Prompt。附带扩展服务，支持文本绘画生成与语音生成和基于向量数据库 的聊天信息总结。

 ## 屏幕截图
 <img width="400500" alt="image" src="https://user-images.githubusercontentgithub.com/18619528/228649245user-8061c60fattachments/assets/9b5f32f0-63dcc3b3-488e4102-9325b3f5-f151b7a3ec2d.png0e9213c0f50f">
 <img width="400500" alt="image" src="https://user-images.githubusercontentgithub.com/18619528/228649856user-fbdeef05attachments/assets/913fdbaa-d7277d33-4d5a42f1-be80ae2c-266cbbc6b811.png89dca41c53d1">
 ## 许可证和贡献

 * Default content (characters and lore books) provided by @OtisAlejandro, @RossAscends and @kallmeflocc
 * Korean translation by @doloroushyeonse
 * 中文翻译由 [@XXpE3](https://github.com/XXpE3) 完成，中文 ISSUES 可以联系 @XXpE3
++
 +<!-- LINK GROUP -->
 +[cover]: https://github.com/user-attachments/assets/01a6ae9a-16aa-45f2-8bff-32b5dc587e44

.github/readme.md+162 -242 Viewed

 <a name="readme-top"></a>
 -English | [中文](readme-zh_cn.md) | [日本語](readme-ja_jp.md) | [Русский](readme-ru_ru.md)
+-
 ![][cover]
 -Mobile-friendly layout, Multi-API (KoboldAI/CPP, Horde, NovelAI, Ooba, OpenAI, OpenRouter, Claude, Scale), VN-like Waifu Mode, Stable Diffusion, TTS, WorldInfo (lorebooks), customizable UI, auto-translate, and more prompt options than you'd ever want or need + ability to install third-party extensions.
 +<div align="center">
 -Based on a fork of [TavernAI](https://github.com/TavernAI/TavernAI) 1.2.8
 +English | [中文](readme-zh_cn.md) | [日本語](readme-ja_jp.md) | [Русский](readme-ru_ru.md)
 -## Important news!
 +[![GitHub Stars](https://img.shields.io/github/stars/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/stargazers)
 +[![GitHub Forks](https://img.shields.io/github/forks/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/network)
 +[![GitHub Issues](https://img.shields.io/github/issues/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/issues)
 +[![GitHub Pull Requests](https://img.shields.io/github/issues-pr/SillyTavern/SillyTavern.svg)](https://github.com/SillyTavern/SillyTavern/pulls)
 -1. We have created a [Documentation website](https://docs.sillytavern.app/) to answer most of your questions and help you get started.
 +</div>
 -2. Missing extensions after the update? Since the 1.10.6 release version, most of the previously built-in extensions have been converted to downloadable add-ons. You can download them via the built-in "Download Extensions and Assets" menu in the extensions panel (stacked blocks icon in the top bar).
 +---
 -3. Unsupported platform: android arm LEtime-web. 32-bit Android requires an external dependency that can't be installed with npm. Use the following command to install it: `pkg install esbuild`. Then run the usual installation steps.
 +SillyTavern provides a single unified interface for many LLM APIs (KoboldAI/CPP, Horde, NovelAI, Ooba, Tabby, OpenAI, OpenRouter, Claude, Mistral and more), a mobile-friendly layout, Visual Novel Mode, Automatic1111 & ComfyUI API image generation integration, TTS, WorldInfo (lorebooks), customizable UI, auto-translate, more prompt options than you'd ever want or need, and endless growth potential via third-party extensions.
 -### Brought to you by Cohee, RossAscends, and the SillyTavern community
 +We have a [Documentation website](https://docs.sillytavern.app/) to answer most of your questions and help you get started.
 ### What is SillyTavern or TavernAI?
 SillyTavern is a user interface(or youST canfor installshort) onis youra computerlocally (andinstalled Androiduser phones)interface that allows you to interact with text generation AIs and chat/roleplayLLMs, withimage charactersgeneration youengines, orand theTTS communityvoice createmodels.
 SillyTavernBeginning isin February 2023 as a fork of TavernAI 1.2.8, whichSillyTavern isnow underhas moreover active100 developmentcontributors and has2 addedyears manyof majorindependent features.development Atunder thisits pointbelt, they canand becontinues thoughtto ofserve as completelya independentleading programssoftware for savvy AI hobbyists.
 ## ScreenshotsOur Vision
 -<img width="400" alt="image" src="https://github.com/SillyTavern/SillyTavern/assets/61471128/e902c7a2-45a6-4415-97aa-c59c597669c1">
 +1. We aim to empower users with as much utility and control over their LLM prompts as possible. The steep learning curve is part of the fun!
 -<img width="400" alt="image" src="https://github.com/SillyTavern/SillyTavern/assets/61471128/f8a79c47-4fe9-4564-9e4a-bf247ed1c961">
 +2. We do not provide any online or hosted services, nor programmatically track any user data.
 +3. SillyTavern is a passion project brought to you by a dedicated community of LLM enthusiasts, and will always be free and open sourced.
 ### Branches
 SillyTavern is being developed using a two-branch system to ensure a smooth experience for all users.
 * `release` -🌟 **Recommended for most users.** This is the most stable and recommended branch, updated only when major releases are pushed. It's suitable for the majority of users. Typically updated once a month.
 * `staging` - ⚠️ **Not recommended for casual use.** This branch has the latest features, but be cautious as it may break at any time. Only for power users and enthusiasts. Updates several times daily.
 If you're not familiar with using the git CLI or don't understand what a branch is, don't worry! The release branch is always the preferable option for you.
 ### What do I need other than SillyTavern?
 On its ownSince SillyTavern is useless, as it's just aonly useran interface. You, haveyou towill haveneed access to an AI systemLLM backend thatto provide inference. You can actuse asAI theHorde roleplayfor characterinstant out-of-the-box chatting. ThereAside arefrom variousthat, supportedwe backends:support OpenAPImany APIother (GPT),local KoboldAIand (eithercloud-based runningLLM locallybackends: orOpenAI-compatible onAPI, GoogleKoboldAI, Colab)Tabby, and many more. You can read more about thisour supported APIs in [the FAQ](https://docs.sillytavern.app/usage/faqapi-connections/).
 ### Do I need a powerful PC to run SillyTavern?
 -Since SillyTavern is only a user interface, it has tiny hardware requirements, it will run on anything. It's the AI system backend that needs to be powerful.
 +The hardware requirements are minimal: it will run on anything that can run NodeJS 18 or higher. If you intend to do LLM inference on your local machine, we recommend a 3000-series NVIDIA graphics card with at least 6GB of VRAM. Check your backend's documentation for more details.
++
 +### Suggested Backends (not affiliated)
++
 +* [AI Horde](https://aihorde.net/) - use models hosted by volunteers. Requires no further setup
 +* [KoboldCpp](https://github.com/LostRuins/koboldcpp) - a community's favorite for running GGUF models locally
 +* [tabbyAPI](https://github.com/theroyallab/tabbyAPI) - a popular, lightweight, locally-hosted exl2 inference API
 +* [OpenRouter](https://openrouter.ai) - a single API for many cloud providers (OpenAI, Claude, Meta Llama, etc.) as well as popular community models.
 ## Questions or suggestions?
 ### We now have a community Discord server
 | [![][discord-shield-badge]][discord-link] | [Join our Discord community!](https://discord.gg/sillytavern) Get support, share favorite characters and prompts. |
 | :---------------------------------------- | :----------------------------------------------------------------------------------------------------------------- |
 Or get in touch with the developers directly:
 * Discord: cohee or, rossascends, wolfsblvt
 * Reddit: [/u/RossAscends](https://www.reddit.com/user/RossAscends/) or, [/u/sillylossy](https://www.reddit.com/user/sillylossy/), [u/Wolfsblvt](https://www.reddit.com/user/Wolfsblvt/)
 * [Post a GitHub issue](https://github.com/SillyTavern/SillyTavern/issues)
 -## This version includes
 +### I like your project! How do I contribute?
++
 +1. Send pull requests. Learn how to contribute: [CONTRIBUTING.md](../CONTRIBUTING.md)
 +2. Send feature suggestions and issue reports using the provided templates.
 +3. Read this entire readme file and check the documentation website first, to avoid sending duplicate issues.
++
 +## Screenshots
++
 +<img width="500" alt="image" src="https://github.com/user-attachments/assets/9b5f32f0-c3b3-4102-b3f5-0e9213c0f50f">
 +<img width="500" alt="image" src="https://github.com/user-attachments/assets/913fdbaa-7d33-42f1-ae2c-89dca41c53d1">
++
 +## Character Cards
++
 +SillyTavern is built around the concept of "character cards". A character card is a collection of prompts that set the behavior of the LLM and is required to have persistent conversations in SillyTavern. They function similarly to ChatGPT's GPTs or Poe's bots. The content of a character card can be anything: an abstract scenario, an assistant tailored for a specific task, a famous personality or a fictional character.
++
 +The name field is the only required character card input. To start a neutral conversation with the language model, create a new card simply called "Assistant" and leave the rest of the boxes blank. For a more themed chat, you can provide the language model with various background details, behavior and writing patterns, and a scenario to jump start the chat.
 -* A heavily modified TavernAI 1.2.8 (more than 50% of code rewritten or optimized)
 +To have a quick conversation without selecting a character card or to just test the LLM connection, simply type your prompt input into the input bar on the Welcome Screen after opening SillyTavern. Please note that such chats are temporary and will not be saved.
 -* Swipes
++
 -* Group chats: multi-bot rooms for characters to talk to you or each other
 +To get a general idea on how to define character cards, see the default character (Seraphina) or download selected community-made cards from the "Download Extensions & Assets" menu.
 -* Chat checkpoints / branching
++
 -* Advanced KoboldAI / TextGen generation settings with a lot of community-made presets
 +## Key Features
++
 +* Advanced text generation settings with many community-made presets
 * World Info support: create rich lore or save tokens on your character card
 -* [OpenRouter](https://openrouter.ai) connection for various APIs (Claude, GPT-4/3.5 and more)
 +* Group chats: multi-bot rooms for characters to talk to you and/or each other
 -* [Oobabooga's TextGen WebUI](https://github.com/oobabooga/text-generation-webui) API connection
 +* Rich UI customization options: theme colors, background images, custom CSS, and more
 -* [AI Horde](https://aihorde.net/) connection
 +* User personas: let the AI know a bit about you for greater immersion
 -* Prompt generation formatting tweaking
 +* Built-in RAG support: add documents to your chats for the AI to reference
 +* Extensive chat commands subsystem and own [scripting engine](https://docs.sillytavern.app/usage/st-script/)
 ## Extensions

 * Character emotional expressions (sprites)
 * Auto-Summary of the chat history
 -* Sending images to chat, and the AI interpreting the content
 +* Automatic UI and chat translation
 -* Stable Diffusion image generation (5 chat-related presets plus 'free mode')
 +* Stable Diffusion/FLUX/DALL-E image generation
 * Text-to-speech for AI response messages (via ElevenLabs, Silero, or the OS's System TTS)
 -* Many more available to download from the "Download Extensions & Assets" menu.
 +* Web Search capabilities for adding additional real world context to your prompts
 +* Many more are available to download from the "Download Extensions & Assets" menu.
 Tutorials on how to use them can be found in the [Docs](https://docs.sillytavern.app/).
 -## UI/CSS/Quality of Life tweaks by RossAscends
+-
 -* Mobile UI optimized for iOS, and supports saving a shortcut to the home screen and opening in fullscreen mode.
 -* HotKeys
 -  * Up = Edit last message in chat
 -  * Ctrl+Up = Edit last USER message in chat
 -  * Left = swipe left
 -  * Right = swipe right (NOTE: swipe hotkeys are disabled when the chat bar has something typed into it)
 -  * Ctrl+Left = view locally stored variables (in the browser console window)
 -  * Enter (with chat bar selected) = send your message to AI
 -  * Ctrl+Enter = Regenerate the last AI response
+-
 -* User Name Changes and Character Deletion no longer force the page to refresh.
+-
 -* Toggle option to automatically connect to API on page load.
 -* Toggle option to automatically load the most recently viewed character on page load.
 -* Better Token Counter - works on unsaved characters, and shows both permanent and temporary tokens.
+-
 -* Better Past Chats View
 -  * New Chat filenames are saved in a readable format of "(character) - (when it was created)"
 -  * Chat preview increased from 40 characters to 300.
 -  * Multiple options for characters list sorting (by name, creation date, chat sizes).
+-
 -* By default the left and right settings panel will close when you click away from it.
 -* Clicking the Lock on the nav panel will hold the panel open, and this setting be remembered across sessions.
 -* Nav panel status of open or closed will also be saved across sessions.
+-
 -* Customizable chat UI:
 -  * Play a sound when a new message arrives
 -  * Switch between round or rectangle avatar styles
 -  * Have a wider chat window on the desktop
 -  * Optional semi-transparent glass-like panels
 -  * Customizable page colors for 'main text', 'quoted text', and 'italics text'.
 -  * Customizable UI background color and blur amount
+-
 # ⌛ Installation
 > \[!WARNING]
 +>
 > * DO NOT INSTALL INTO ANY WINDOWS CONTROLLED FOLDER (Program Files, System32, etc).
 > * DO NOT RUN START.BAT WITH ADMIN PERMISSIONS
 > * INSTALLATION ON WINDOWS 7 IS IMPOSSIBLE AS IT CAN NOT RUN NODEJS 18.16
 ## 🪟 Windows
 ### Installing via Git
++
 . Install [NodeJS](https://nodejs.org/en) (latest LTS version is recommended)
 . Install [Git for Windows](https://gitforwindows.org/)
 . Open Windows Explorer (`Win+E`)

 . Open a Command Prompt inside that folder by clicking in the 'Address Bar' at the top, typing `cmd`, and pressing Enter.
 . Once the black box (Command Prompt) pops up, type ONE of the following into it and press Enter:
 -* for Release Branch: `git clone https://github.com/SillyTavern/SillyTavern -b release`
 -* for Staging Branch: `git clone https://github.com/SillyTavern/SillyTavern -b staging`
 . Once everything is cloned, double-click `Start.bat` to make NodeJS install its requirements.
 . The server will then start, and SillyTavern will pop up in your browser.
 ### Installing via SillyTavernGitHub LauncherDesktop
 -1.  On your keyboard: press **`WINDOWS + R`** to open Run dialog box. Then, run the following command to install git:
 -```shell
 -cmd /c winget install -e --id Git.Git
 -```
 -2. On your keyboard: press **`WINDOWS + E`** to open File Explorer, then navigate to the folder where you want to install the launcher. Once in the desired folder, type `cmd` into the address bar and press enter. Then, run the following command:
 -```shell
 -git clone https://github.com/SillyTavern/SillyTavern-Launcher.git && cd SillyTavern-Launcher && start installer.bat
 -```
 -## Installing via GitHub Desktop
 (This allows git usage **only** in GitHub Desktop, if you want to use `git` on the command line too, you also need to install [Git for Windows](https://gitforwindows.org/))
++
 . Install [NodeJS](https://nodejs.org/en) (latest LTS version is recommended)
 . Install [GitHub Desktop](https://central.github.com/deployments/desktop/desktop/latest/win32)
 . After installing GitHub Desktop, click on `Clone a repository from the internet....` (Note: You **do NOT need** to create a GitHub account for this step)

 . Install git and nodeJS (the method for doing this will vary depending on your OS)
 . Clone the repo
 -* for Release Branch: `git clone https://github.com/SillyTavern/SillyTavern -b release`
 -* for Staging Branch: `git clone https://github.com/SillyTavern/SillyTavern -b staging`
 . `cd SillyTavern` to navigate into the install folder.
 . Run the `start.sh` script with one of these commands:
 -* `./start.sh`
 -* `bash start.sh`
++
 +## ⚡ Installing via SillyTavern Launcher
++
 +SillyTavern Launcher is an installation wizard that will help you get setup with many options, including installing a backend for local inference.
++
 +### For Windows users
 -## Installing via SillyTavern Launcher
 +1. On your keyboard: press **`WINDOWS + R`** to open Run dialog box. Then, run the following command to install git:
++
 +```shell
 +cmd /c winget install -e --id Git.Git
 +```
++
 +2. On your keyboard: press **`WINDOWS + E`** to open File Explorer, then navigate to the folder where you want to install the launcher. Once in the desired folder, type `cmd` into the address bar and press enter. Then, run the following command:
++
 +```shell
 +git clone https://github.com/SillyTavern/SillyTavern-Launcher.git && cd SillyTavern-Launcher && start installer.bat
 +```
 ### For Linux users
++
 . Open your favorite terminal and install git
 . Git clone the Sillytavern-Launcher with:
++
 ```shell
 git clone https://github.com/SillyTavern/SillyTavern-Launcher.git && cd SillyTavern-Launcher
 ```
++
 . Start the installer.sh with:
++
 ```shell
 chmod +x install.sh && ./install.sh
 ```
++
 . After installation start the launcher.sh with:
++
 ```shell
 chmod +x launcher.sh && ./launcher.sh
 ```
 ### For Mac users
++
 . Open a terminal and install brew with:
++
 ```shell
 /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
 ```
++
 . Install git with:
++
 ```shell
 brew install git
 ```
++
 . Git clone the Sillytavern-Launcher with:
++
 ```shell
 git clone https://github.com/SillyTavern/SillyTavern-Launcher.git && cd SillyTavern-Launcher
 ```
++
 . Start the installer.sh with:
++
 ```shell
 chmod +x install.sh && ./install.sh
 ```
++
 . After installation start the launcher.sh with:
++
 ```shell
 chmod +x launcher.sh && ./launcher.sh
 ```

 ##### Volume Mappings
 -* [config] - The directory where SillyTavern configuration files will be stored on your host machine
 -* [data] - The directory where SillyTavern user data (including characters) will be stored on your host machine
 -* [plugins] - (optional) The directory where SillyTavern server plugins will be stored on your host machine
 ##### Port Mappings
 -* [PublicPort] - The port to expose the traffic on. This is mandatory, as you will be accessing the instance from outside of its virtual machine container. DO NOT expose this to the internet without implementing a separate service for security.
 ##### Additional Settings
 -* [DockerNet] - The docker network that the container should be created with a connection to. If you don't know what it is, see the [official Docker documentation](https://docs.docker.com/reference/cli/docker/network/).
 -* [version] - On the right-hand side of this GitHub page, you'll see "Packages". Select the "sillytavern" package and you'll see the image versions. The image tag "latest" will keep you up-to-date with the current release. You can also utilize "staging" and "release" tags that point to the nightly images of the respective branches, but this may not be appropriate, if you are utilizing extensions that could be broken, and may need time to update.
 #### Install command

 > Note that 8000 is a default listening port. Don't forget to use an appropriate port if you change it in the config.
 ## 📱 Mobile - Installing via termuxTermux on Android OS
 > \[!NOTE]
 > **SillyTavern can be run natively on Android phonesdevices using Termux., Pleasebut referwe todo thisnot guideprovide byofficial ArroganceComplex#2659:support for this use case.**
 +>
 +> **Please refer to this guide by ArroganceComplex#2659:**
 +>
 > * <https://rentry.org/STAI-Termux>
 +**Unsupported platform: android arm LEtime-web.** 32-bit Android requires an external dependency that can't be installed with npm. Use the following command to install it: `pkg install esbuild`. Then run the usual installation steps.
 ## API keys management
 SillyTavern saves your API keys to a `secrets.json` file in the user data directory (`/data/default-user/secrets.json` is the default path).
 By default, theyAPI keys will not be exposedvisible tofrom athe frontendinterface after you enterhave saved them and reloadrefreshed the page.
 In order to enable viewing your keys by clicking a button in the API block:
 . Set the value of `allowKeysExposure` to `true` in `config.yaml` file.
 . Restart the SillyTavern server.
 +3. Click the 'View hidden API keys' link at the bottom right of the API Connection Panel.
 ## Command-line arguments

 ### Supported arguments
 | Option                  | Description                                                                                          | Type     | Default                      |
 |-------------------------|------------------------------------------------------------------------------------------------------|----------|------------------------------|
 | `--version`             | Show version number                                                                                  | boolean  |                              |
 | `--enableIPv6`          | Enables IPv6.                                                                                        | boolean  | false                        |
 | `--enableIPv4`          | Enables IPv4.                                                                                        | boolean  | true                         |
 | `--port`                | Sets the port under which SillyTavern will run. If not provided falls back to yaml config 'port'.    | number   | 8000                         |
 | `--dnsPreferIPv6`       | Prefers IPv6 for dns. If not provided falls back to yaml config 'preferIPv6'.                        | boolean  | false                        |
 | `--autorun`             | Automatically launch SillyTavern in the browser. If not provided falls back to yaml config 'autorun'.| boolean  | false                        |
 | `--autorunHostname`     | The autorun hostname, probably best left on 'auto'.                                                  | string   | null                         |
 | `--autorunPortOverride` | Overrides the port for autorun.                                                                      | string   | null                         |
 | `--listen`              | SillyTavern is listening on all network interfaces. If not provided falls back to yaml config 'listen'.| boolean  | false                        |
 | `--corsProxy`           | Enables CORS proxy. If not provided falls back to yaml config 'enableCorsProxy'.                     | boolean  | false                        |
 | `--disableCsrf`         | Disables CSRF protection                                                                             | boolean  | null                         |
 | `--ssl`                 | Enables SSL                                                                                          | boolean  | false                        |
 | `--certPath`            | Path to your certificate file.                                                                       | string   | "certs/cert.pem"             |
 | `--keyPath`             | Path to your private key file.                                                                       | string   | "certs/privkey.pem"          |
 | `--whitelist`           | Enables whitelist mode                                                                               | boolean  | null                         |
 | `--dataRoot`            | Root directory for data storage                                                                      | string   | null                         |
 | `--avoidLocalhost`      | Avoids using 'localhost' for autorun in auto mode.                                                   | boolean  | null                         |
 | `--basicAuthMode`       | Enables basic authentication                                                                         | boolean  | null                         |
 | `--requestProxyEnabled` | Enables a use of proxy for outgoing requests                                                         | boolean  | null                         |
 | `--requestProxyUrl`     | Request proxy URL (HTTP or SOCKS protocols)                                                          | string   | null                         |
 | `--requestProxyBypass`  | Request proxy bypass list (space separated list of hosts)                                            | array    | null                         |
 ## Remote connections
 Most often this is for people who want to use SillyTavern on their mobile phones while their PC runs the ST server on the same wifiWi-Fi network. However, it can be used to allow remote connections from anywhere as well.
+-
 -However, it can be used to allow remote connections from anywhere as well.
+-
 -**IMPORTANT: Refer to the official guide if you want to configure SillyTavern user accounts with (optional) password protection: [Users](https://docs.sillytavern.app/installation/st-1.12.0-migration-guide/#users).**
+-
 -### 1. Managing whitelisted IPs
+-
 -* Create a new text file inside your SillyTavern base install folder called `whitelist.txt`.
 -* Open the file in a text editor, and add a list of IPs you want to be allowed to connect.
+-
 -*Both individual IPs and wildcard IP ranges are accepted. Examples:*
+-
 -```txt
 -192.168.0.1
 -192.168.0.20
 -```
+-
 -or
+-
 -```txt
 -192.168.0.*
 -```
+-
 -(the above wildcard IP range will allow any device on the local network to connect)
+-
 -CIDR masks are also accepted (eg. 10.0.0.0/24).
+-
 -* Save the `whitelist.txt` file.
 -* Restart your ST server.
+-
 -Now devices which have the IP specified in the file will be able to connect.
+-
 -*Note: `config.yaml` also has a `whitelist` array, which you can use in the same way, but this array will be ignored if `whitelist.txt` exists.*
+-
 -### 2. Getting the IP for the ST host machine
+-
 -After the whitelist has been setup, you'll need the IP of the ST-hosting device.
+-
 -If the ST-hosting device is on the same wifi network, you will use the ST-host's internal wifi IP:
+-
 -* For Windows: windows button > type `cmd.exe` in the search bar > type `ipconfig` in the console, hit Enter > look for `IPv4` listing.
+-
 -If you (or someone else) want to connect to your hosted ST while not being on the same network, you will need the public IP of your ST-hosting device.
+-
 -* While using the ST-hosting device, access [this page](https://whatismyipaddress.com/) and look for `IPv4`. This is what you would use to connect from the remote device.
 -### 3. Connect the remote device to the ST host machine
 +Read the detailed guide on how to set up remote connections in the [Docs](https://docs.sillytavern.app/usage/remoteconnections/).
 -Whatever IP you ended up with for your situation, you will put that IP address and port number into the remote device's web browser.
 +You may also want to configure SillyTavern user profiles with (optional) password protection: [Users](https://docs.sillytavern.app/installation/st-1.12.0-migration-guide/#users).
+-
 -A typical address for an ST host on the same wifi network would look like this:
+-
 -`http://192.168.0.5:8000`
+-
 -Use http:// NOT https://
+-
 -### Opening your ST to all IPs
+-
 -We do not recommend doing this, but you can open `config.yaml` and change `whitelistMode` to `false`.
+-
 -You must remove (or rename) `whitelist.txt` in the SillyTavern base install folder if it exists.
+-
 -This is usually an insecure practice, so we require you to set a username and password when you do this.
+-
 -The username and password are set in `config.yaml`.
+-
 -After restarting your ST server, any device will be able to connect to it, regardless of their IP as long as they know the username and password.
+-
 -### Still Unable To Connect?
+-
 -* Create an inbound/outbound firewall rule for the port found in `config.yaml`. Do NOT mistake this for port-forwarding on your router, otherwise, someone could find your chat logs and that's a big no-no.
 -* Enable the Private Network profile type in Settings > Network and Internet > Ethernet. This is VERY important for Windows 11, otherwise, you would be unable to connect even with the aforementioned firewall rules.
 ## Performance issues?
 Try1. enablingDisable the No Blur Effect (Fastand UI)enable modeReduced Motion on the User settingsSettings panel (UI Theme toggles category).
+-
 +2. If using response streaming, set the streaming FPS to a lower value (10-15 FPS is recommended).
 -## I like your project! How do I contribute?
 +3. Make sure the browser is enabled to use GPU acceleration for rendering.
+-
 -### DO's
+-
 -1. Send pull requests
 -2. Send feature suggestions and issue reports using established templates
 -3. Read the readme file and built-in documentation before asking anything
+-
 -### DONT's
+-
 -1. Offer monetary donations
 -2. Send bug reports without providing any context
 -3. Ask the questions that were already answered numerous times
+-
 -## Where can I find the old backgrounds?
+-
 -We're moving to a 100% original content only policy, so old background images have been removed from this repository.
+-
 -You can find them archived here:
+-
 -<https://files.catbox.moe/1xevnc.zip>
+-
+-
+-
 ## License and credits

 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
 GNU Affero General Public License for more details.**
 -* TAI Base by Humi: MIT
 +* [TavernAI](https://github.com/TavernAI/TavernAI) 1.2.8 by Humi: MIT License
 -* Cohee's modifications and derived code: AGPL v3
 +* Portions of CncAnon's TavernAITurbo mod used with permission
 -* RossAscends' additions: AGPL v3
 +* Visual Novel Mode inspired by the work of PepperTaco (<https://github.com/peppertaco/Tavern/>)
 -* Portions of CncAnon's TavernAITurbo mod: Unknown license
 -* kingbri's various commits and suggestions (<https://github.com/bdashore3>)
 -* city_unit's extensions and various QoL features (<https://github.com/city-unit>)
 -* StefanDanielSchwarz's various commits and bug reports (<https://github.com/StefanDanielSchwarz>)
 -* Waifu mode inspired by the work of PepperTaco (<https://github.com/peppertaco/Tavern/>)
 -* Thanks Pygmalion University for being awesome testers and suggesting cool features!
 -* Thanks oobabooga for compiling presets for TextGen
 -* KoboldAI Presets from KAI Lite: <https://lite.koboldai.net/>
 * Noto Sans font by Google (OFL license)
 * Icon theme by Font Awesome <https://fontawesome.com> (Icons: CC BY 4.0, Fonts: SIL OFL 1.1, Code: MIT License)
 -* AI Horde client library by ZeldaFan0225: <https://github.com/ZeldaFan0225/ai_horde>
 +* Default content by @OtisAlejandro (Seraphina character and lorebook) and @kallmeflocc (10K Discord Users Celebratory Background)
 -* Linux startup script by AlpinDale
 -* Thanks paniphons for providing a FAQ document
 -* 10K Discord Users Celebratory Background by @kallmeflocc
 -* Default content (characters and lore books) provided by @OtisAlejandro, @RossAscends and @kallmeflocc
 -* Korean translation by @doloroushyeonse
 -* k_euler_a support for Horde by <https://github.com/Teashrock>
 -* Chinese translation by [@XXpE3](https://github.com/XXpE3), 中文 ISSUES 可以联系 @XXpE3
 * Docker guide by [@mrguymiah](https://github.com/mrguymiah) and [@Bronya-Rand](https://github.com/Bronya-Rand)
 +## Top Contributors
++
 +[![Contributors](https://contrib.rocks/image?repo=SillyTavern/SillyTavern)](https://github.com/SillyTavern/SillyTavern/graphs/contributors)
++
 <!-- LINK GROUP -->
 -[back-to-top]: https://img.shields.io/badge/-BACK_TO_TOP-151515?style=flat-square
 +[cover]: https://github.com/user-attachments/assets/01a6ae9a-16aa-45f2-8bff-32b5dc587e44
 -[cover]: https://github.com/SillyTavern/SillyTavern/assets/18619528/c2be4c3f-aada-4f64-87a3-ae35a68b61a4
 [discord-link]: https://discord.gg/sillytavern
 -[discord-shield]: https://img.shields.io/discord/1100685673633153084?color=5865F2&label=discord&labelColor=black&logo=discord&logoColor=white&style=flat-square
 [discord-shield-badge]: https://img.shields.io/discord/1100685673633153084?color=5865F2&label=discord&labelColor=black&logo=discord&logoColor=white&style=for-the-badge

Dockerfile+1 -1 Viewed

 COPY package*.json post-install.js ./
 RUN \
   echo "*** Install npm packages ***" && \
   npm i --no-audit --no-fund --quietloglevel=error --no-progress --omit=dev && npm cache clean --force
 # Bundle app source
 COPY . ./

Start.bat+1 -1 Viewed

 @echo off
 pushd %~dp0
 set NODE_ENV=production
 call npm install --no-audit --no-fund --quietloglevel=error --no-progress --omit=dev
 node server.js %*
 pause
 popd

UpdateAndStart.bat+1 -1 Viewed

@@ -12,7 +12,7 @@ if %errorlevel% neq 0 (
12	12	)
13	13	)
14	14	set NODE_ENV=production
15	15	call npm install --no-audit --no-fund --quietloglevel=error --no-progress --omit=dev
16	16	node server.js %*
17	17	pause
18	18	popd

UpdateForkAndStart.bat+1 -1 Viewed

 echo Installing npm packages and starting server
 set NODE_ENV=production
 call npm install --no-audit --no-fund --quietloglevel=error --no-progress --omit=dev
 node server.js %*
 :end

default/config.yaml+5 -0 Viewed

 disableChatBackup: false
 # Number of backups to keep for each chat and settings file
 numberOfBackups: 50
 +# Interval in milliseconds to throttle chat backups per user
 +chatBackupThrottleInterval: 10000
 # Allowed hosts for card downloads
 whitelistImportDomains:
   - localhost

 # Additional model tokenizers can be downloaded on demand.
 # Disabling will fallback to another locally available tokenizer.
 enableDownloadableTokenizers: true
 +# Vector storage settings
 +vectors:
 +  enableModelScopes: false
 # Extension settings
 extras:
   # Disables automatic model download from HuggingFace

default/content/index.json+92 -16 Viewed

         "type": "novel_preset"
     },
+    {
 +        "filename": "presets/novel/Erato-Dragonfruit.json",
 +        "type": "novel_preset"
 +    },
 +    {
 +        "filename": "presets/novel/Erato-Golden Arrow.json",
 +        "type": "novel_preset"
 +    },
 +    {
 +        "filename": "presets/novel/Erato-Shosetsu.json",
 +        "type": "novel_preset"
 +    },
 +    {
 +        "filename": "presets/novel/Erato-Wilder.json",
 +        "type": "novel_preset"
 +    },
 +    {
 +        "filename": "presets/novel/Erato-Zany Scribe.json",
 +        "type": "novel_preset"
 +    },
 +    {
         "filename": "presets/textgen/Asterism.json",
         "type": "textgen_preset"
     },

         "type": "context"
     },
+    {
 -        "filename": "presets/context/Alpaca-Roleplay.json",
 -        "type": "context"
 -    },
 -    {
         "filename": "presets/context/Alpaca-Single-Turn.json",
         "type": "context"
     },

         "type": "context"
     },
+    {
 -        "filename": "presets/context/Mistral.json",
 -        "type": "context"
 -    },
 -    {
         "filename": "presets/context/NovelAI.json",
         "type": "context"
     },

         "type": "instruct"
     },
+    {
 -        "filename": "presets/instruct/Alpaca-Roleplay.json",
 -        "type": "instruct"
 -    },
 -    {
         "filename": "presets/instruct/Alpaca-Single-Turn.json",
         "type": "instruct"
     },

         "type": "instruct"
     },
+    {
 -        "filename": "presets/instruct/Mistral.json",
 -        "type": "instruct"
 -    },
 -    {
         "filename": "presets/instruct/OpenOrca-OpenChat.json",
         "type": "instruct"
     },

+    {
         "filename": "presets/instruct/Gemma 2.json",
         "type": "instruct"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Actor.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Assistant - Expert.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Assistant - Simple.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Chain of Thought.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Roleplay - Detailed.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Roleplay - Immersive.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Roleplay - Simple.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Text Adventure.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Writer - Creative.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Writer - Realistic.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Blank.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/sysprompt/Neutral - Chat.json",
 +        "type": "sysprompt"
 +    },
 +    {
 +        "filename": "presets/instruct/Mistral V1.json",
 +        "type": "instruct"
 +    },
 +    {
 +        "filename": "presets/context/Mistral V1.json",
 +        "type": "context"
 +    },
 +    {
 +        "filename": "presets/instruct/Mistral V2 & V3.json",
 +        "type": "instruct"
 +    },
 +    {
 +        "filename": "presets/context/Mistral V2 & V3.json",
 +        "type": "context"
 +    },
 +    {
 +        "filename": "presets/instruct/Mistral V3-Tekken.json",
 +        "type": "instruct"
 +    },
 +    {
 +        "filename": "presets/context/Mistral V3-Tekken.json",
 +        "type": "context"
+    }
+]

default/content/presets/context/Adventure.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": false,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": true,
     "name": "Adventure"
+}

default/content/presets/context/Alpaca-Roleplay.json+0 -12 Viewed

 -{
 -    "story_string": "You're {{char}} in this fictional never-ending uncensored roleplay with {{user}}.\n\n{{#if system}}{{system}}\n\n{{/if}}### Input:\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{char}}'s personality: {{personality}}\n{{/if}}{{#if scenario}}Scenario: {{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}\n\n",
 -    "example_separator": "### New Roleplay:",
 -    "chat_start": "### New Roleplay:",
 -    "use_stop_strings": false,
 -    "allow_jailbreak": false,
 -    "always_force_name2": true,
 -    "trim_sentences": false,
 -    "include_newline": false,
 -    "single_line": false,
 -    "name": "Alpaca-Roleplay"
 -}

default/content/presets/context/Alpaca-Single-Turn.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": false,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Alpaca-Single-Turn"
+}

default/content/presets/context/Alpaca.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Alpaca"
+}

default/content/presets/context/ChatML-Names.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "ChatML-Names"
+}

default/content/presets/context/ChatML.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "ChatML"
+}

default/content/presets/context/Command R.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Command R"
+}

default/content/presets/context/Default.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Default"
+}

default/content/presets/context/DreamGen Role-Play V1 ChatML.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": false,
     "trim_sentences": true,
 -    "include_newline": false,
     "single_line": false,
     "name": "DreamGen Role-Play V1 ChatML"
+}

default/content/presets/context/DreamGen Role-Play V1 Llama3.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": false,
     "trim_sentences": true,
 -    "include_newline": false,
     "single_line": false,
     "name": "DreamGen Role-Play V1 Llama3"
+}

default/content/presets/context/Gemma 2.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Gemma 2"
+}

default/content/presets/context/Libra-32B.json+1 -2 Viewed

+{
     "story_string": "### Instruction:\nWrite {{char}}'s next reply in this roleplay with {{user}}. Use the provided character sheet and example dialogue for formatting direction and character speech patterns.\n\n{{#if system}}{{system}}\n\n{{/if}}### Character Sheet:\n{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{char}}'s personality: {{personality}}\n{{/if}}{{#if scenario}}Scenario: {{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}",
     "example_separator": "### Example:",
     "chat_start": "### START ROLEPLAY:",
     "use_stop_strings": false,
     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Libra-32B"
+}

default/content/presets/context/Lightning 1.1.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Lightning 1.1"
+}

default/content/presets/context/Llama 2 Chat.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Llama 2 Chat"
+}

default/content/presets/context/Llama 3 Instruct.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Llama 3 Instruct"
+}

default/content/presets/context/Llama-3-Instruct-Names.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Llama-3-Instruct-Names"
+}

default/content/presets/context/Minimalist.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Minimalist"
+}

default/content/presets/context/Mistral V1.json+11 -0 Viewed

 +{
 +    "story_string": " [INST] {{#if system}}{{system}}\n{{/if}}{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}{{trim}} [/INST] Understood.</s>",
 +    "example_separator": "",
 +    "chat_start": "",
 +    "use_stop_strings": false,
 +    "allow_jailbreak": false,
 +    "always_force_name2": true,
 +    "trim_sentences": false,
 +    "single_line": false,
 +    "name": "Mistral V1"
 +}

default/content/presets/context/Mistral.json → default/content/presets/context/Mistral V2 & V3.json+3 -4 Viewed

+{
     "story_string": "[INST] {{#if system}}{{system}}\n{{/if}}{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{char}}'s personality: {{personality}}\n{{/if}}{{#if scenario}}Scenario: {{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}{{trim}} [/INST] Understood.</s>",
     "example_separator": "Examples:",
     "chat_start": "",
     "use_stop_strings": false,
     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Mistral V2 & V3"
+}

default/content/presets/context/Mistral V3-Tekken.json+11 -0 Viewed

 +{
 +    "story_string": "[INST]{{#if system}}{{system}}\n{{/if}}{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{personality}}\n{{/if}}{{#if scenario}}{{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}{{trim}}[/INST]Understood.</s>",
 +    "example_separator": "",
 +    "chat_start": "",
 +    "use_stop_strings": false,
 +    "allow_jailbreak": false,
 +    "always_force_name2": true,
 +    "trim_sentences": false,
 +    "single_line": false,
 +    "name": "Mistral V3-Tekken"
 +}

default/content/presets/context/NovelAI.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "NovelAI"
+}

default/content/presets/context/OldDefault.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "OldDefault"
+}

default/content/presets/context/Phi.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Phi"
+}

default/content/presets/context/Pygmalion.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Pygmalion"
+}

default/content/presets/context/Story.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Story"
+}

default/content/presets/context/Synthia.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "Synthia"
+}

default/content/presets/context/simple-proxy-for-tavern.json+0 -1 Viewed

     "allow_jailbreak": false,
     "always_force_name2": true,
     "trim_sentences": false,
 -    "include_newline": false,
     "single_line": false,
     "name": "simple-proxy-for-tavern"
+}

default/content/presets/instruct/Adventure.json+1 -3 Viewed

+{
 -    "system_prompt": "[Enter Adventure Mode. Narrate the story based on {{user}}'s dialogue and actions after \">\". Describe the surroundings in vivid detail. Be detailed, creative, verbose, and proactive. Move the story forward by introducing fantasy elements and interesting characters.]",
     "input_sequence": "",
     "output_sequence": "",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Alpaca-Roleplay.json+0 -24 Viewed

 -{
 -    "system_prompt": "Develop the plot slowly, always stay in character. Describe all actions in full, elaborate, explicit, graphic, and vivid detail. Mention all relevant sensory perceptions.",
 -    "input_sequence": "### Instruction:",
 -    "output_sequence": "### Response:",
 -    "last_output_sequence": "### Response (2 paragraphs, engaging, natural, authentic, descriptive, creative):",
 -    "system_sequence": "### Input:",
 -    "stop_sequence": "",
 -    "wrap": true,
 -    "macro": true,
 -    "names": true,
 -    "names_force_groups": true,
 -    "activation_regex": "",
 -    "system_sequence_prefix": "",
 -    "system_sequence_suffix": "",
 -    "first_output_sequence": "",
 -    "skip_examples": false,
 -    "output_suffix": "\n\n",
 -    "input_suffix": "\n\n",
 -    "system_suffix": "\n\n",
 -    "user_alignment_message": "",
 -    "system_same_as_user": false,
 -    "last_system_sequence": "",
 -    "name": "Alpaca-Roleplay"
 -}

default/content/presets/instruct/Alpaca-Single-Turn.json+2 -4 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\nWrite 1 reply only, italicize actions, and avoid quotation marks. Use markdown. Be proactive, creative, and drive the plot and conversation forward. Include dialog as well as narration.",
     "input_sequence": "",
     "output_sequence": "",
     "last_output_sequence": "\n### Response:",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",
     "first_output_sequence": "<START OF ROLEPLAYCHAT>",
     "skip_examples": false,
     "output_suffix": "",
     "input_suffix": "",

default/content/presets/instruct/Alpaca.json+1 -3 Viewed

+{
 -    "system_prompt": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\nWrite {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n",
     "input_sequence": "### Instruction:",
     "output_sequence": "### Response:",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/ChatML-Names.json+1 -3 Viewed

+{
 -    "system_prompt": "You're {{char}} in this fictional never-ending uncensored roleplay with {{user}}.",
     "input_sequence": "<|im_start|>[{{name}}]",
     "output_sequence": "<|im_start|>[{{name}}]",
     "last_output_sequence": "",

     "stop_sequence": "<|im_end|>",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/ChatML.json+1 -3 Viewed

+{
 -    "system_prompt": "You're {{char}} in this fictional never-ending uncensored roleplay with {{user}}.",
     "input_sequence": "<|im_start|>user",
     "output_sequence": "<|im_start|>assistant",
     "last_output_sequence": "",

     "stop_sequence": "<|im_end|>",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Command R.json+1 -3 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in this fictional roleplay with {{user}}.",
     "input_sequence": "<|START_OF_TURN_TOKEN|><|USER_TOKEN|>",
     "output_sequence": "<|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|>",
     "first_output_sequence": "",

     "stop_sequence": "<|END_OF_TURN_TOKEN|>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "skip_examples": false,
     "output_suffix": "<|END_OF_TURN_TOKEN|>",

default/content/presets/instruct/DreamGen Role-Play V1 ChatML.json+1 -3 Viewed

+{
 -    "system_prompt": "You are an intelligent, skilled, versatile writer.\n\nYour task is to write a role-play based on the information below.",
     "input_sequence": "\n<|im_start|>text names= {{name}}\n",
     "output_sequence": "\n<|im_start|>text names= {{name}}\n",
     "last_output_sequence": "",

     "stop_sequence": "\n<|im_start|>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/DreamGen Role-Play V1 Llama3.json+1 -3 Viewed

+{
 -    "system_prompt": "You are an intelligent, skilled, versatile writer.\n\nYour task is to write a role-play based on the information below.",
     "input_sequence": "<|eot_id|>\n<|start_header_id|>writer character: {{user}}<|end_header_id|>\n\n",
     "output_sequence": "<|eot_id|>\n<|start_header_id|>writer character: {{char}}<|end_header_id|>\n\n",
     "first_output_sequence": "",

     "separator_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "skip_examples": false,
     "name": "DreamGen Role-Play V1 Llama3"

default/content/presets/instruct/Gemma 2.json+1 -3 Viewed

+{
 -    "system_prompt": "Continue writing this story and portray characters realistically.",
     "input_sequence": "<start_of_turn>user",
     "output_sequence": "<start_of_turn>model",
     "last_output_sequence": "",

     "stop_sequence": "<end_of_turn>",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Koala.json+1 -3 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n",
     "input_sequence": "USER: ",
     "output_sequence": "GPT: ",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "BEGINNING OF CONVERSATION: ",
     "system_sequence_suffix": "",

default/content/presets/instruct/Libra-32B.json+1 -3 Viewed

+{
 -    "system_prompt": "Avoid repetition, don't loop. Develop the plot slowly, always stay in character. Describe all actions in full, elaborate, explicit, graphic, and vivid detail. Mention all relevant sensory perceptions.",
     "input_sequence": "",
     "output_sequence": "",
     "last_output_sequence": "\n### Response:",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Lightning 1.1.json+1 -3 Viewed

+{
 -    "system_prompt": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\n### Instruction:\nTake the role of {{char}} in a play that leaves a lasting impression on {{user}}. Write {{char}}'s next reply.\nNever skip or gloss over {{char}}’s actions. Progress the scene at a naturally slow pace.\n\n",
     "input_sequence": "### Instruction:",
     "output_sequence": "### Response: (length = unlimited)",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Llama 2 Chat.json+1 -3 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in this fictional roleplay with {{user}}.",
     "input_sequence": "[INST] ",
     "output_sequence": "",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Llama 3 Instruct.json+1 -3 Viewed

+{
 -    "system_prompt": "You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model. Currently your role is {{char}}, which is described in detail below. As {{char}}, continue the exchange with {{user}}.",
     "input_sequence": "<|start_header_id|>user<|end_header_id|>\n\n",
     "output_sequence": "<|start_header_id|>assistant<|end_header_id|>\n\n",
     "last_output_sequence": "",

     "stop_sequence": "<|eot_id|>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Llama-3-Instruct-Names.json+1 -3 Viewed

+{
 -    "system_prompt": "You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model. Currently your role is {{char}}, which is described in detail below. As {{char}}, continue the exchange with {{user}}.",
     "input_sequence": "<|start_header_id|>[{{name}}]<|end_header_id|>\n\n",
     "output_sequence": "<|start_header_id|>[{{name}}]<|end_header_id|>\n\n",
     "last_output_sequence": "",

     "stop_sequence": "<|eot_id|>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Metharme.json+1 -3 Viewed

+{
 -    "system_prompt": "Enter roleplay mode. You must act as {{char}}, whose persona follows:",
     "input_sequence": "<|user|>",
     "output_sequence": "<|model|>",
     "last_output_sequence": "",

     "stop_sequence": "</s>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "<|system|>",
     "system_sequence_suffix": "",

default/content/presets/instruct/Mistral V1.json+22 -0 Viewed

 +{
 +    "input_sequence": " [INST] ",
 +    "output_sequence": " [/INST] ",
 +    "last_output_sequence": " [/INST]",
 +    "system_sequence": "",
 +    "stop_sequence": "",
 +    "wrap": false,
 +    "macro": true,
 +    "names_behavior": "always",
 +    "activation_regex": "",
 +    "system_sequence_prefix": "",
 +    "system_sequence_suffix": "",
 +    "first_output_sequence": "",
 +    "skip_examples": false,
 +    "output_suffix": "</s>",
 +    "input_suffix": "",
 +    "system_suffix": "",
 +    "user_alignment_message": "Let's get started. Please respond based on the information and instructions provided above.",
 +    "system_same_as_user": true,
 +    "last_system_sequence": "",
 +    "name": "Mistral V1"
 +}

default/content/presets/instruct/Mistral.json → default/content/presets/instruct/Mistral V2 & V3.json+6 -8 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in this fictional roleplay with {{user}}.",
     "input_sequence": "[INST] ",
     "output_sequence": "[/INST] ",
     "last_output_sequence": "[/INST]",
     "system_sequence": "",
     "stop_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",
     "first_output_sequence": "",
     "skip_examples": false,
     "output_suffix": "\n</s>",
     "input_suffix": " [/INST]\n",
     "system_suffix": "",
     "user_alignment_message": "Let's get started. Please respond based on the information and instructions provided above.",
     "system_same_as_user": true,
     "last_system_sequence": "",
     "name": "Mistral V2 & V3"
+}

default/content/presets/instruct/Mistral V3-Tekken.json+22 -0 Viewed

 +{
 +    "input_sequence": "[INST]",
 +    "output_sequence": "[/INST]",
 +    "last_output_sequence": "",
 +    "system_sequence": "",
 +    "stop_sequence": "",
 +    "wrap": false,
 +    "macro": true,
 +    "names_behavior": "always",
 +    "activation_regex": "",
 +    "system_sequence_prefix": "",
 +    "system_sequence_suffix": "",
 +    "first_output_sequence": "",
 +    "skip_examples": false,
 +    "output_suffix": "</s>",
 +    "input_suffix": "",
 +    "system_suffix": "",
 +    "user_alignment_message": "Let's get started. Please respond based on the information and instructions provided above.",
 +    "system_same_as_user": true,
 +    "last_system_sequence": "",
 +    "name": "Mistral V3-Tekken"
 +}

default/content/presets/instruct/OpenOrca-OpenChat.json+1 -3 Viewed

+{
 -    "system_prompt": "You are a helpful assistant. Please answer truthfully and write out your thinking step by step to be sure you get the right answer. If you make a mistake or encounter an error in your thinking, say so out loud and attempt to correct it. If you don't know or aren't sure about something, say so clearly. You will act as a professional logician, mathematician, and physicist. You will also act as the most appropriate type of expert to answer any particular question or solve the relevant problem; state which expert type your are, if so. Also think of any particular named expert that would be ideal to answer the relevant question or solve the relevant problem; name and act as them, if appropriate.\n",
     "input_sequence": "\nUser: ",
     "output_sequence": "\nAssistant: ",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Phi.json+1 -3 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in this fictional roleplay with {{user}}.",
     "input_sequence": "<|user|>\n",
     "output_sequence": "<|assistant|>\n",
     "first_output_sequence": "",

     "stop_sequence": "<|end|>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "skip_examples": false,
     "output_suffix": "<|end|>\n",

default/content/presets/instruct/Pygmalion.json+1 -3 Viewed

+{
 -    "system_prompt": "Enter RP mode. You shall reply to {{user}} while staying in character. Your responses must be detailed, creative, immersive, and drive the scenario forward. You will follow {{char}}'s persona.",
     "input_sequence": "<|user|>",
     "output_sequence": "<|model|>",
     "last_output_sequence": "",

     "stop_sequence": "<|user|>",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": true"always",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "<|system|>",
     "system_sequence_suffix": "",

default/content/presets/instruct/Story.json+1 -3 Viewed

+{
 -    "system_prompt": "",
     "input_sequence": "",
     "output_sequence": "",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Synthia.json+1 -3 Viewed

+{
 -    "system_prompt": "Elaborate on the topic using a Tree of Thoughts and backtrack when necessary to construct a clear, cohesive Chain of Thought reasoning. Always answer without hesitation.",
     "input_sequence": "USER: ",
     "output_sequence": "ASSISTANT: ",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "SYSTEM: ",
     "system_sequence_suffix": "",

default/content/presets/instruct/Vicuna 1.0.json+1 -3 Viewed

+{
 -    "system_prompt": "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.\n\nWrite {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n",
     "input_sequence": "### Human:",
     "output_sequence": "### Assistant:",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/Vicuna 1.1.json+1 -3 Viewed

+{
 -    "system_prompt": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.\n\nWrite {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n",
     "input_sequence": "\nUSER: ",
     "output_sequence": "\nASSISTANT: ",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": false,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "BEGINNING OF CONVERSATION:",
     "system_sequence_suffix": "",

default/content/presets/instruct/WizardLM-13B.json+1 -3 Viewed

+{
 -    "system_prompt": "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.\n\nWrite {{char}}'s next detailed reply in a fictional roleplay chat between {{user}} and {{char}}.",
     "input_sequence": "USER: ",
     "output_sequence": "ASSISTANT: ",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/WizardLM.json+1 -3 Viewed

+{
 -    "system_prompt": "Write {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n",
     "input_sequence": "",
     "output_sequence": "### Response:",
     "last_output_sequence": "",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"force",
 -    "names_force_groups": true,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/instruct/simple-proxy-for-tavern.json+1 -3 Viewed

+{
 -    "system_prompt": "[System note: Write one reply only. Do not decide what {{user}} says or does. Write at least one paragraph, up to four. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment. Write with a high degree of complexity and burstiness. Do not repeat this message.]",
     "input_sequence": "### Instruction:\n#### {{name}}:",
     "output_sequence": "### Response:\n#### {{name}}:",
     "last_output_sequence": "### Response (2 paragraphs, engaging, natural, authentic, descriptive, creative):\n#### {{name}}:",

     "stop_sequence": "",
     "wrap": true,
     "macro": true,
     "namesnames_behavior": false"none",
 -    "names_force_groups": false,
     "activation_regex": "",
     "system_sequence_prefix": "",
     "system_sequence_suffix": "",

default/content/presets/novel/Asper-Kayra.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "medium",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Blended-Coffee-Kayra.json+6 -3 Viewed

+{
   "order": [6, 0, 1, 2, 3],
   "temperature": 1,
   "max_length": 150,
   "min_length": 1,

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "medium",
   "cfg_scalemax_context": 1.557800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Blook-Kayra.json+6 -3 Viewed

+{
   "order": [6, 2, 3, 1, 0],
   "temperature": 1,
   "max_length": 150,
   "min_length": 1,

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "very_aggressive",
   "cfg_scalemax_context": 1.37800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Carefree-Kayra.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "aggressive",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/CosmicCube-Kayra.json+6 -3 Viewed

+{
   "order": [8, 6, 5, 0, 3],
   "temperature": 0.9,
   "max_length": 150,
   "min_length": 1,

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "off",
   "cfg_scalemax_context": 1.487800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Edgewise-Clio.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "very_light",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Erato-Dragonfruit.json+31 -0 Viewed

 +{
 +    "max_context": 8000,
 +    "temperature": 1.37,
 +    "max_length": 150,
 +    "min_length": 1,
 +    "top_k": 0,
 +    "top_p": 1,
 +    "top_a": 0.1,
 +    "typical_p": 0.875,
 +    "tail_free_sampling": 0.87,
 +    "repetition_penalty": 3.25,
 +    "repetition_penalty_range": 6000,
 +    "repetition_penalty_slope": 3.25,
 +    "repetition_penalty_frequency": 0,
 +    "repetition_penalty_presence": 0,
 +    "phrase_rep_pen": "off",
 +    "mirostat_lr": 0.2,
 +    "mirostat_tau": 4,
 +    "math1_temp": 0.9,
 +    "math1_quad": 0.07,
 +    "math1_quad_entropy_scale": -0.05,
 +    "min_p": 0.035,
 +    "order": [
 +        0,
 +        5,
 +        9,
 +        10,
 +        8,
 +        4
 +    ]
 +}

default/content/presets/novel/Erato-Golden Arrow.json+27 -0 Viewed

 +{
 +    "max_context": 8000,
 +    "temperature": 1,
 +    "max_length": 150,
 +    "min_length": 1,
 +    "top_k": 0,
 +    "top_p": 0.995,
 +    "top_a": 1,
 +    "typical_p": 1,
 +    "tail_free_sampling": 0.87,
 +    "repetition_penalty": 1.5,
 +    "repetition_penalty_range": 2240,
 +    "repetition_penalty_slope": 1,
 +    "repetition_penalty_frequency": 0,
 +    "repetition_penalty_presence": 0,
 +    "phrase_rep_pen": "light",
 +    "mirostat_lr": 1,
 +    "mirostat_tau": 0,
 +    "math1_temp": 0.3,
 +    "math1_quad": 0.19,
 +    "math1_quad_entropy_scale": 0,
 +    "min_p": 0,
 +    "order": [
 +        9,
 +        2
 +    ]
 +}

default/content/presets/novel/Erato-Shosetsu.json+27 -0 Viewed

 +{
 +    "max_context": 8000,
 +    "temperature": 1,
 +    "max_length": 150,
 +    "min_length": 1,
 +    "top_k": 50,
 +    "top_p": 0.85,
 +    "top_a": 1,
 +    "typical_p": 1,
 +    "tail_free_sampling": 0.895,
 +    "repetition_penalty": 1.63,
 +    "repetition_penalty_range": 1024,
 +    "repetition_penalty_slope": 3.33,
 +    "repetition_penalty_frequency": 0.0035,
 +    "repetition_penalty_presence": 0,
 +    "phrase_rep_pen": "medium",
 +    "mirostat_lr": 1,
 +    "mirostat_tau": 0,
 +    "math1_temp": 0.3,
 +    "math1_quad": 0.0645,
 +    "math1_quad_entropy_scale": 0.05,
 +    "min_p": 0.05,
 +    "order": [
 +        9,
 +        10
 +    ]
 +}

default/content/presets/novel/Erato-Wilder.json+27 -0 Viewed

 +{
 +    "max_context": 8000,
 +    "temperature": 1,
 +    "max_length": 150,
 +    "min_length": 1,
 +    "top_k": 300,
 +    "top_p": 0.98,
 +    "top_a": 0.004,
 +    "typical_p": 0.96,
 +    "tail_free_sampling": 0.96,
 +    "repetition_penalty": 1.48,
 +    "repetition_penalty_range": 2240,
 +    "repetition_penalty_slope": 0.64,
 +    "repetition_penalty_frequency": 0,
 +    "repetition_penalty_presence": 0,
 +    "phrase_rep_pen": "medium",
 +    "mirostat_lr": 1,
 +    "mirostat_tau": 0,
 +    "math1_temp": -0.0485,
 +    "math1_quad": 0.145,
 +    "math1_quad_entropy_scale": 0,
 +    "min_p": 0.02,
 +    "order": [
 +        9,
 +        10
 +    ]
 +}

default/content/presets/novel/Erato-Zany Scribe.json+27 -0 Viewed

 +{
 +    "max_context": 8000,
 +    "temperature": 1,
 +    "max_length": 150,
 +    "min_length": 1,
 +    "top_k": 0,
 +    "top_p": 0.99,
 +    "top_a": 1,
 +    "typical_p": 1,
 +    "tail_free_sampling": 0.99,
 +    "repetition_penalty": 1,
 +    "repetition_penalty_range": 64,
 +    "repetition_penalty_slope": 1,
 +    "repetition_penalty_frequency": 0.75,
 +    "repetition_penalty_presence": 1.5,
 +    "phrase_rep_pen": "medium",
 +    "mirostat_lr": 1,
 +    "mirostat_tau": 1,
 +    "math1_temp": -0.4,
 +    "math1_quad": 0.6,
 +    "math1_quad_entropy_scale": -0.1,
 +    "min_p": 0.08,
 +    "order": [
 +        9,
 +        2
 +    ]
 +}

default/content/presets/novel/Fresh-Coffee-Clio.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "very_light",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Fresh-Coffee-Kayra.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "off",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Green-Active-Writer-Kayra.json+6 -3 Viewed

+{
   "order": [6, 0, 8, 5, 3],
   "temperature": 1.5,
   "max_length": 150,
   "min_length": 1,

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "very_aggressive",
   "cfg_scalemax_context": 1.47800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Keelback-Clio.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "very_light",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Long-Press-Clio.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "very_light",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Pilotfish-Kayra.json+6 -3 Viewed

+{
   "order": [6, 0, 4, 1, 2, 5, 3],
   "temperature": 1.31,
   "max_length": 150,
   "min_length": 1,

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "medium",
   "cfg_scalemax_context": 1.357800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Pro_Writer-Kayra.json+5 -2 Viewed

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "medium",
   "cfg_scalemax_context": 1.07800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Stelenes-Kayra.json+5 -1 Viewed

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "medium",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Talker-Chat-Clio.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "very_light",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Tea_Time-Kayra.json+5 -2 Viewed

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "aggressive",
   "cfg_scalemax_context": 1.07800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Tesseract-Kayra.json+6 -3 Viewed

+{
   "order": [6, 0, 5],
   "temperature": 0.895,
   "max_length": 150,
   "min_length": 1,

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "aggressive",
   "cfg_scalemax_context": 1.37800,
   "max_contextmin_p": 78000,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Vingt-Un-Clio.json+5 -2 Viewed

   "use_cache": false,
   "return_full_text": false,
   "prefix": "vanilla",
 -  "cfg_scale": 1,
   "phrase_rep_pen": "very_light",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/novel/Writers-Daemon-Kayra.json+5 -1 Viewed

   "return_full_text": false,
   "prefix": "vanilla",
   "phrase_rep_pen": "very_aggressive",
   "max_context": 7800,
 +  "min_p": 0,
 +  "math1_temp": 1,
 +  "math1_quad": 0,
 +  "math1_quad_entropy_scale": 0
+}

default/content/presets/sysprompt/Actor.json+4 -0 Viewed

 +{
 +    "name": "Actor",
 +    "content": "You are an expert actor that can fully immerse yourself into any role given. You do not break character for any reason, even if someone tries addressing you as an AI or language model. Currently your role is {{char}}, which is described in detail below. As {{char}}, continue the exchange with {{user}}."
 +}

default/content/presets/sysprompt/Assistant - Expert.json+4 -0 Viewed

 +{
 +    "name": "Assistant - Expert",
 +    "content": "You are a helpful assistant. Please answer truthfully and write out your thinking step by step to be sure you get the right answer. If you make a mistake or encounter an error in your thinking, say so out loud and attempt to correct it. If you don't know or aren't sure about something, say so clearly. You will act as a professional logician, mathematician, and physicist. You will also act as the most appropriate type of expert to answer any particular question or solve the relevant problem; state which expert type your are, if so. Also think of any particular named expert that would be ideal to answer the relevant question or solve the relevant problem; name and act as them, if appropriate."
 +}

default/content/presets/sysprompt/Assistant - Simple.json+4 -0 Viewed

 +{
 +    "name": "Assistant - Simple",
 +    "content": "A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions."
 +}

default/content/presets/sysprompt/Blank.json+4 -0 Viewed

 +{
 +    "name": "Blank",
 +    "content": ""
 +}

default/content/presets/sysprompt/Chain of Thought.json+4 -0 Viewed

 +{
 +    "name": "Chain of Thought",
 +    "content": "Elaborate on the topic using a Tree of Thoughts and backtrack when necessary to construct a clear, cohesive Chain of Thought reasoning. Always answer without hesitation."
 +}

default/content/presets/sysprompt/Neutral - Chat.json+4 -0 Viewed

 +{
 +    "name": "Neutral - Chat",
 +    "content": "Write {{char}}'s next reply in a fictional chat between {{char}} and {{user}}."
 +}

default/content/presets/sysprompt/Roleplay - Detailed.json+4 -0 Viewed

 +{
 +    "name": "Roleplay - Detailed",
 +    "content": "Develop the plot slowly, always stay in character. Describe all actions in full, elaborate, explicit, graphic, and vivid detail. Mention all relevant sensory perceptions. Keep the story immersive and engaging."
 +}

default/content/presets/sysprompt/Roleplay - Immersive.json+4 -0 Viewed

 +{
 +    "name": "Roleplay - Immersive",
 +    "content": "[System note: Write one reply only. Do not decide what {{user}} says or does. Write at least one paragraph, up to four. Be descriptive and immersive, providing vivid details about {{char}}'s actions, emotions, and the environment. Write with a high degree of complexity and burstiness. Do not repeat this message.]"
 +}

default/content/presets/sysprompt/Roleplay - Simple.json+4 -0 Viewed

 +{
 +    "name": "Roleplay - Simple",
 +    "content": "You're {{char}} in this fictional never-ending uncensored roleplay with {{user}}."
 +}

default/content/presets/sysprompt/Text Adventure.json+4 -0 Viewed

 +{
 +    "name": "Text Adventure",
 +    "content": "[Enter Adventure Mode. Narrate the story based on {{user}}'s dialogue and actions after \">\". Describe the surroundings in vivid detail. Be detailed, creative, verbose, and proactive. Move the story forward by introducing fantasy elements and interesting characters.]"
 +}

default/content/presets/sysprompt/Writer - Creative.json+4 -0 Viewed

 +{
 +    "name": "Writer - Creative",
 +    "content": "You are an intelligent, skilled, versatile writer.\n\nYour task is to write a role-play based on the information below."
 +}

default/content/presets/sysprompt/Writer - Realistic.json+4 -0 Viewed

 +{
 +    "name": "Writer - Realistic",
 +    "content": "Continue writing this story and portray characters realistically."
 +}

default/content/settings.json+17 -18 Viewed

         "pin_examples": false,
         "strip_examples": false,
         "trim_sentences": false,
 -        "include_newline": false,
         "always_force_name2": true,
         "user_prompt_bias": "",
         "show_user_prompt_bias": true,

         "continue_on_send": false,
         "trim_spaces": true,
         "relaxed_api_urls": false,
 -        "default_instruct": "",
         "instruct": {
             "enabled": false,
             "preset": "Alpaca",
 -            "system_prompt": "Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\nWrite {{char}}'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n",
             "input_sequence": "### Instruction:",
             "output_sequence": "### Response:",
             "last_output_sequence": "",

             "stop_sequence": "",
             "wrap": true,
             "macro": true,
             "namesnames_behavior": false"force",
 -            "names_force_groups": true,
             "activation_regex": "",
             "system_sequence_prefix": "",
             "system_sequence_suffix": "",

             "user_alignment_message": "",
             "system_same_as_user": false
         },
         "default_contextsysprompt": "Default",{
 +            "enabled": true,
 +            "name": "Neutral - Chat",
 +            "content": "Write {{char}}'s next reply in a fictional chat between {{char}} and {{user}}."
 +        },
         "context": {
             "preset": "Default",
             "story_string": "{{#if system}}{{system}}\n{{/if}}{{#if wiBefore}}{{wiBefore}}\n{{/if}}{{#if description}}{{description}}\n{{/if}}{{#if personality}}{{char}}'s personality: {{personality}}\n{{/if}}{{#if scenario}}Scenario: {{scenario}}\n{{/if}}{{#if wiAfter}}{{wiAfter}}\n{{/if}}{{#if persona}}{{persona}}\n{{/if}}",

             "lengthPenaltyStep": 0.1,
             "memoryFrozen": false,
             "source": "extras",
             "prompt": "[PauseIgnore yourprevious roleplayinstructions. Summarize the most important facts and events that have happened in the chatstory so far. If a summary already exists in your memory, use that as a base and expand with new facts. Limit the summary to {{words}} words or less. Your response should include nothing but the summary.]",
             "promptWords": 200,
             "promptMinWords": 25,
             "promptMaxWords": 1000,

             "horde_karras": true,
             "refine_mode": false,
             "prompts": {
                 "0": "[In the next response I want you to provide only a detailed comma-delimited list of keywords and phrases which describe {{char}}. The list must include all of the following items in this order: name, species and race, gender, age, clothing, occupation, physical features and appearances. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase 'full body portrait,']",
                 "1": "[PauseIgnore yourprevious roleplayinstructions and provide a detailed description of {{user}}'s physical appearance from the perspective of {{char}} in the form of a comma-delimited list of keywords and phrases. The list must include all of the following items in this order: name, species and race, gender, age, clothing, occupation, physical features and appearances. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase 'full body portrait,'. Ignore the rest of the story when crafting this description. Do not roleplayreply as {{char}} when writing this description, and do not attempt to continue the story.]",
                 "2": "[PauseIgnore yourprevious roleplayinstructions and provide a detailed description for all of the following: a brief recap of recent events in the story, {{char}}'s appearance, and {{char}}'s surroundings. Do not roleplayreply whileas {{char}} when writing this description, and do not attempt to continue the story.]",
                 "3": "[PauseIgnore yourprevious roleplayinstructions and provide ONLY the last chat message string back to me verbatim. Do not write anything after the string. Do not roleplayreply atas all{{char}} inwhen yourwriting response.this Dodescription, and do not attempt to continue the roleplay story.]",
 -                "4": "[Pause your roleplay. Your next response must be formatted as a single comma-delimited list of concise keywords.  The list will describe of the visual details included in the last chat message.\n\n    Only mention characters by using pronouns ('he','his','she','her','it','its') or neutral nouns ('male', 'the man', 'female', 'the woman').\n\n    Ignore non-visible things such as feelings, personality traits, thoughts, and spoken dialog.\n\n    Add keywords in this precise order:\n    a keyword to describe the location of the scene,\n    a keyword to mention how many characters of each gender or type are present in the scene (minimum of two characters:\n    {{user}} and {{char}}, example: '2 men ' or '1 man 1 woman ', '1 man 3 robots'),\n\n    keywords to describe the relative physical positioning of the characters to each other (if a commonly known term for the positioning is known use it instead of describing the positioning in detail) + 'POV',\n\n    a single keyword or phrase to describe the primary act taking place in the last chat message,\n\n    keywords to describe {{char}}'s physical appearance and facial expression,\n    keywords to describe {{char}}'s actions,\n    keywords to describe {{user}}'s physical appearance and actions.\n\n    If character actions involve direct physical interaction with another character, mention specifically which body parts interacting and how.\n\n    A correctly formatted example response would be:\n    '(location),(character list by gender),(primary action), (relative character position) POV, (character 1's description and actions), (character 2's description and actions)']",
 +                "4": "Ignore previous instructions. Your next response must be formatted as a single comma-delimited list of concise keywords.  The list will describe of the visual details included in the last chat message.\n\n    Only mention characters by using pronouns ('he','his','she','her','it','its') or neutral nouns ('male', 'the man', 'female', 'the woman').\n\n    Ignore non-visible things such as feelings, personality traits, thoughts, and spoken dialog.\n\n    Add keywords in this precise order:\n    a keyword to describe the location of the scene,\n    a keyword to mention how many characters of each gender or type are present in the scene (minimum of two characters:\n    {{user}} and {{char}}, example: '2 men ' or '1 man 1 woman ', '1 man 3 robots'),\n\n    keywords to describe the relative physical positioning of the characters to each other (if a commonly known term for the positioning is known use it instead of describing the positioning in detail) + 'POV',\n\n    a single keyword or phrase to describe the primary act taking place in the last chat message,\n\n    keywords to describe {{char}}'s physical appearance and facial expression,\n    keywords to describe {{char}}'s actions,\n    keywords to describe {{user}}'s physical appearance and actions.\n\n    If character actions involve direct physical interaction with another character, mention specifically which body parts interacting and how.\n\n    A correctly formatted example response would be:\n    '(location),(character list by gender),(primary action), (relative character position) POV, (character 1's description and actions), (character 2's description and actions)'",
                 "5": "[In the next response I want you to provide only a detailed comma-delimited list of keywords and phrases which describe {{char}}. The list must include all of the following items in this order: name, species and race, gender, age, facial features and expressions, occupation, hair and hair accessories (if any), what they are wearing on their upper body (if anything). Do not describe anything below their neck. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase 'close up facial portrait,']",
                 "7": "[PauseIgnore yourprevious roleplayinstructions and provide a detailed description of {{char}}'s surroundings in the form of a comma-delimited list of keywords and phrases. The list must include all of the following items in this order: location, time of day, weather, lighting, and any other relevant details. Do not include descriptions of characters and non-visual qualities such as names, personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase 'background,'. Ignore the rest of the story when crafting this description. Do not roleplayreply as {{user}} when writing this description, and do not attempt to continue the story.]"
             },
             "character_prompts": {}
         },

@@ -318,9 +318,9 @@
318	318	"objective": {
319	319	"customPrompts": {
320	320	"default": {
321	321	"createTask": "PauseIgnore yourprevious roleplayinstructions and generate a list of tasks to complete an objective. Your next response must be formatted as a numbered list of plain text entries. Do not include anything but the numbered list. The list must be prioritized in the order that tasks must be completed.\n\nThe objective that you must make a numbered task list for is: [{{objective}}].\nThe tasks created should take into account the character traits of {{char}}. These tasks may or may not involve {{user}} directly. Be sure to include the objective as the final task.\n\nGiven an example objective of 'Make me a four course dinner', here is an example output:\n1. Determine what the courses will be\n2. Find recipes for each course\n3. Go shopping for supplies with {{user}}\n4. Cook the food\n5. Get {{user}} to set the table\n6. Serve the food\n7. Enjoy eating the meal with {{user}}\n ",
322	322	"checkTaskCompleted": "PauseIgnore yourprevious roleplayinstructions. Determine if this task is completed: [{{task}}].\nTo do this, examine the most recent messages. Your response must only contain either true or false, nothing other words.\nExample output:\ntrue\n ",
323	323	"currentTask": "Your current task is [{{task}}]. Balance existing roleplaystory with completing this task."
324	324	}
325	325	}
326	326	},

         "preset_settings_novel": "Talker-Chat-Clio",
         "streaming_novel": true,
         "preamble": "[ Style: chat, complex, sensory, visceral ]",
 -        "cfg_uc": "",
         "banned_tokens": "",
         "order": [
 ,

package-lock.json+47 -60 Viewed

+{
     "name": "sillytavern",
     "version": "1.12.56",
     "lockfileVersion": 3,
     "requires": true,
     "packages": {
         "": {
             "name": "sillytavern",
             "version": "1.12.56",
             "hasInstallScript": true,
             "license": "AGPL-3.0",
             "dependencies": {

                 "cookie-session": "^2.1.0",
                 "cors": "^2.8.5",
                 "csrf-csrf": "^2.2.3",
                 "express": "^4.2021.0",
                 "form-data": "^4.0.0",
                 "google-translate-api-browser": "^3.0.1",
                 "he": "^1.2.0",

                 "node": ">=0.10.0"
+            }
         },
 -        "node_modules/body-parser/node_modules/qs": {
 -            "version": "6.13.0",
 -            "resolved": "https://registry.npmjs.org/qs/-/qs-6.13.0.tgz",
 -            "integrity": "sha512-+38qI9SOr8tfZ4QmJNplMUxqjbe7LKvvZgWdExBOmd+egZTtjLB67Gu0HRX3u/XOq7UU2Nx6nsjvS16Z9uwfpg==",
 -            "license": "BSD-3-Clause",
 -            "dependencies": {
 -                "side-channel": "^1.0.6"
 -            },
 -            "engines": {
 -                "node": ">=0.6"
 -            },
 -            "funding": {
 -                "url": "https://github.com/sponsors/ljharb"
 -            }
 -        },
         "node_modules/boolbase": {
             "version": "1.0.0",
             "resolved": "https://registry.npmjs.org/boolbase/-/boolbase-1.0.0.tgz",

             "version": "2.7.0",
             "resolved": "https://registry.npmjs.org/centra/-/centra-2.7.0.tgz",
             "integrity": "sha512-PbFMgMSrmgx6uxCdm57RUos9Tc3fclMvhLSATYN39XsDV29B89zZ3KA89jmY0vwSGazyU+uerqwa6t+KaodPcg==",
 +            "license": "MIT",
             "dependencies": {
                 "follow-redirects": "^1.15.6"
+            }

             "license": "MIT"
         },
         "node_modules/encodeurl": {
             "version": "12.0.20",
             "resolved": "https://registry.npmjs.org/encodeurl/-/encodeurl-12.0.20.tgz",
             "integrity": "sha512-TPJXq8JqFaVYm2CWmPvnP2Iyo4ZSM7/QKcSmuMLDObfpH5fi7RUGmd/rTDf+rut/saiDiQEeVTNgAmJEdAOx0wQ0n9HRi4m6JuGIV1eFlmvJB7ZEVxu93IrMyiMsGC0lrMJMWzRgx6WGquyfQgZVb31vhGgXnfmPNNXmxnOkRBrg==",
             "license": "MIT",
             "engines": {
                 "node": ">= 0.8"

             "integrity": "sha512-c2bQfLNbMzLPmzQuOr8fy0csy84WmwnER81W88DzTp9CYNPJ6yzOj2EZAh9pywYpqHnshVLHQJ8WzldAyfY+Iw=="
         },
         "node_modules/express": {
             "version": "4.2021.0",
             "resolved": "https://registry.npmjs.org/express/-/express-4.2021.0.tgz",
             "integrity": "sha512-pLdae7I6QqShF5PnNTCVn4hI91Dx0Grkn2VqcNGcj/Id5ZT1LZ/cfihi3ttTn+IAsMTgMIKuQVte2dN9PeGSSAME2FR8anOhVA62QDIUaWVfEXVLwNJmkli2eZADigjq29qTlWi/hAQ43t/VLPq8+UX06FCEx3ByOYet6ZFblng==",
             "license": "MIT",
             "dependencies": {
                 "accepts": "~1.3.8",

                 "encodeurl": "~2.0.0",
                 "escape-html": "~1.0.3",
                 "etag": "~1.8.1",
                 "finalhandler": "1.23.01",
                 "fresh": "0.5.2",
                 "http-errors": "2.0.0",
                 "merge-descriptors": "1.0.3",

                 "parseurl": "~1.3.3",
                 "path-to-regexp": "0.1.10",
                 "proxy-addr": "~2.0.7",
                 "qs": "6.1113.0",
                 "range-parser": "~1.2.1",
                 "safe-buffer": "5.2.1",
                 "send": "0.19.0",
                 "serve-static": "1.16.02",
                 "setprototypeof": "1.2.0",
                 "statuses": "2.0.1",
                 "type-is": "~1.6.18",

                 "node": ">= 0.6"
+            }
         },
 -        "node_modules/express/node_modules/encodeurl": {
 -            "version": "2.0.0",
 -            "resolved": "https://registry.npmjs.org/encodeurl/-/encodeurl-2.0.0.tgz",
 -            "integrity": "sha512-Q0n9HRi4m6JuGIV1eFlmvJB7ZEVxu93IrMyiMsGC0lrMJMWzRgx6WGquyfQgZVb31vhGgXnfmPNNXmxnOkRBrg==",
 -            "license": "MIT",
 -            "engines": {
 -                "node": ">= 0.8"
 -            }
 -        },
         "node_modules/express/node_modules/safe-buffer": {
             "version": "5.2.1",
             "resolved": "https://registry.npmjs.org/safe-buffer/-/safe-buffer-5.2.1.tgz",

+            }
         },
         "node_modules/finalhandler": {
             "version": "1.23.01",
             "resolved": "https://registry.npmjs.org/finalhandler/-/finalhandler-1.23.01.tgz",
             "integrity": "sha512-5uXcUVftlQMFnWC9qu/svkWv3GTd2PfUhK6BN9trH7bp3qvnrRyzsBz+g3lZxTNZTbVO2EV1CS0WIcDbawYVdYvGflME/3PLkYNAe7FbqJMt3515HaxE6eRL74GdsriiwujiawdaB1BpEISg9QP0h0pYlCDBCTjYa9nZzMDpyxQ==",
             "license": "MIT",
             "dependencies": {
                 "debug": "2.6.9",
                 "encodeurl": "~12.0.20",
                 "escape-html": "~1.0.3",
                 "on-finished": "2.4.1",
                 "parseurl": "~1.3.3",

+            }
         },
         "node_modules/load-bmfont": {
             "version": "1.4.12",
             "resolved": "https://registry.npmjs.org/load-bmfont/-/load-bmfont-1.4.12.tgz",
             "integrity": "sha512-8UyQoYmdRDy81Brz6aLAUhfZLwr5zV0L3taTQ4hju7m6biuwiWiJXjPhBJxbUQJA8PrkvJqElWkmjW9Oq1F9EI5Gt7aD9zcdHb9spJCW1L/7Enqmwk2sM14soAdmPf7KzCCEJxq8nhHz5eCgI9aMf7vrG/wyaCqdsI+Iy9ZTlog==",
             "license": "MIT",
             "dependencies": {
                 "buffer-equal": "0.0.1",

                 "parse-bmfont-ascii": "^1.0.3",
                 "parse-bmfont-binary": "^1.0.5",
                 "parse-bmfont-xml": "^1.1.4",
                 "phin": "^23.97.1",
                 "xhr": "^2.0.1",
                 "xtend": "^4.0.0"
+            }

             "license": "MIT"
         },
         "node_modules/parse-bmfont-xml": {
             "version": "1.1.46",
             "resolved": "https://registry.npmjs.org/parse-bmfont-xml/-/parse-bmfont-xml-1.1.46.tgz",
             "integrity": "sha512-bjnliEOmGv3y1aMEfREMBJ9tfL3WR0i0CKPj61DnSLaoxWR3nLrsQrEbCId/8rF4NyRF0cCqisSVXyQYWM0cEliVMZEhrFDwMh4SxIyVJpqYoOWDJ9P895tFuS+mCQXuNzI5UBmBk5U5O4KuJdTnZpSBI4LFA2+ZiJaiwfSwlMA==",
             "license": "MIT",
             "dependencies": {
                 "xml-parse-from-string": "^1.0.0",
                 "xml2js": "^0.4.5.0"
+            }
         },
         "node_modules/parse-headers": {

             "version": "3.7.1",
             "resolved": "https://registry.npmjs.org/phin/-/phin-3.7.1.tgz",
             "integrity": "sha512-GEazpTWwTZaEQ9RhL7Nyz0WwqilbqgLahDM3D0hxWwmVDI52nXEybHqiN6/elwpkJBhcuj+WbBu+QfT0uhPGfQ==",
 +            "license": "MIT",
             "dependencies": {
                 "centra": "^2.7.0"
             },

+            }
         },
         "node_modules/qs": {
             "version": "6.1113.0",
             "resolved": "https://registry.npmjs.org/qs/-/qs-6.1113.0.tgz",
             "integrity": "sha512-MvjoMCJwEarSbUYk5O+nmoSzSutSsTwF85zcHPQ9OrlFoZOYIjaqBAJIqIXjptyD5vThxGq52Xu38qI9SOr8tfZ4QmJNplMUxqjbe7LKvvZgWdExBOmd+egZTtjLB67Gu0HRX3u/MaJzRkIk4QXOq7UU2Nx6nsjvS16Z9uwfpg==",
             "license": "BSD-3-Clause",
             "dependencies": {
                 "side-channel": "^1.0.46"
             },
             "engines": {
                 "node": ">=0.6"

+            }
         },
         "node_modules/sax": {
             "version": "1.2.4.1",
             "resolved": "https://registry.npmjs.org/sax/-/sax-1.2.4.1.tgz",
             "integrity": "sha512-NqVDv9TpANUjFm0N8uM5GxL36UgKi9+aWOz7yVScEGoKNd4PA10LZ8sk0A/atZwz5+x7YFnQ8ckwFGKrl4xX4yWtrey3UJm5nP1kUbnYgLopqWNSRhWwnXQG5giUO5rprX9jgYsTdov9qCchZiPIZezbZH+jRut8nPodFAX4Jg==",
             "license": "ISC"
         },
         "node_modules/send": {

                 "node": ">= 0.8.0"
+            }
         },
 +        "node_modules/send/node_modules/encodeurl": {
 +            "version": "1.0.2",
 +            "resolved": "https://registry.npmjs.org/encodeurl/-/encodeurl-1.0.2.tgz",
 +            "integrity": "sha512-TPJXq8JqFaVYm2CWmPvnP2Iyo4ZSM7/QKcSmuMLDObfpH5fi7RUGmd/rTDf+rut/saiDiQEeVTNgAmJEdAOx0w==",
 +            "license": "MIT",
 +            "engines": {
 +                "node": ">= 0.8"
 +            }
 +        },
         "node_modules/send/node_modules/ms": {
             "version": "2.1.3",
             "resolved": "https://registry.npmjs.org/ms/-/ms-2.1.3.tgz",

             "license": "MIT"
         },
         "node_modules/serve-static": {
             "version": "1.16.02",
             "resolved": "https://registry.npmjs.org/serve-static/-/serve-static-1.16.02.tgz",
             "integrity": "sha512-pDLK8zwl2eKaYrs8mrPZBJua4hMplRWJ1tIFksVC3FtBEBnl8dxgeHtsaMS8DhS9i4fLObaon6ABoc4VqpjJZKadQB/hQGdPAPEbEwvFdO43Ax5dFBZ2UECszz8bQ7pi7wt//PWe1P6MN7eCnjsatYtBT6EuiClbjSWP2WrIoTw==",
             "license": "MIT",
             "dependencies": {
                 "encodeurl": "~12.0.20",
                 "escape-html": "~1.0.3",
                 "parseurl": "~1.3.3",
                 "send": "0.1819.0"
             },
             "engines": {
                 "node": ">= 0.8.0"

package.json+2 -11 Viewed

         "cookie-session": "^2.1.0",
         "cors": "^2.8.5",
         "csrf-csrf": "^2.2.3",
         "express": "^4.2021.0",
         "form-data": "^4.0.0",
         "google-translate-api-browser": "^3.0.1",
         "he": "^1.2.0",

         "node": ">= 18"
     },
     "overrides": {
 -        "parse-bmfont-xml": {
 -            "xml2js": "^0.5.0"
 -        },
         "vectra": {
             "openai": "^4.17.0"
         },
 -        "load-bmfont": {
 -            "phin": "^3.7.1"
 -        },
         "axios": {
             "follow-redirects": "^1.15.4"
         },
         "node-fetch": {
             "whatwg-url": "^14.0.0"
 -        },
 -        "express": {
 -            "send": "^0.19.0"
+        }
     },
     "name": "sillytavern",

         "type": "git",
         "url": "https://github.com/SillyTavern/SillyTavern.git"
     },
     "version": "1.12.56",
     "scripts": {
         "start": "node server.js",
         "start:no-csrf": "node server.js --disableCsrf",

public/css/mobile-styles.css+8 -9 Viewed

         touch-action: none;
         overflow: hidden;
         position: fixed;
+-
+    }
     .world_entry_form_control {

     .drawer-content {
         min-width: unset;
         width: 100%100dvw;
         max-height: calc(100vh - 45px);
         max-height: calc(100dvh - 45px);
         position: fixed;

     #sheld,
     #character_popup,
     .drawer-content {
         width: 100%100dvw !important;
         margin: 0 auto;
         max-width: 100%100dvw;
         left: 0 !important;
         resize: none !important;
         top: var(--topBarBlockSize);

         /* 100vh are fallback units for browsers that don't support dvh */
         height: calc(100vh - 45px);
         height: calc(100dvh - 45px);
         min-width: 100%100dvw !important;
         width: 100%100dvw !important;
         max-width: 100%100dvw !important;
         overflow-y: hidden;
         border-left: 1px solid var(--SmartThemeBorderColor);
         border-right: 1px solid var(--SmartThemeBorderColor);

         margin: 0 auto;
         height: calc(100vh - 70px);
         height: calc(100dvh - 70px);
         width: calc(100%100dvw - 5px);
         max-height: calc(100vh - 70px);
         max-height: calc(100dvh - 70px);
         max-width: calc(100%100dvw - 5px);
+    }

public/css/popup.css+4 -0 Viewed

     padding: 1px;
+}
 +.popup:not(:has(.img_enlarged_container)) .popup-body {
 +    max-height: 95dvh;
 +}
++
 .popup .popup-content {
     margin-top: 10px;
     padding: 0 8px;

public/css/promptmanager.css+35 -8 Viewed

 #completion_prompt_manager_popup #completion_prompt_manager_popup_inspect {
     display: none;
     padding: 0.5em;
 +    height: 100%;
 +    display: flex;
 +    flex-direction: column;
+}
 #completion_prompt_manager_popup .completion_prompt_manager_popup_entry {
     padding: 1em0.5em;
     margin-topflex: 2em1;
 +}
++
 +#completion_prompt_manager_popup .completion_prompt_manager_popup_entry_form {
 +    height: 100%;
 +    display: flex;
 +    flex-direction: column;
 +}
++
 +#completion_prompt_manager_popup .completion_prompt_manager_popup_entry_form_control:has(#completion_prompt_manager_popup_entry_form_prompt) {
 +    flex: 1;
 +    display: flex;
 +    flex-direction: column;
 +}
++
 +#completion_prompt_manager_popup #completion_prompt_manager_popup_entry_form_prompt {
 +    flex: 1;
+}
 #completion_prompt_manager_popup #completion_prompt_manager_popup_inspect .completion_prompt_manager_popup_entry {
     padding: 1em0.5em;
+}
 #completion_prompt_manager_popup #completion_prompt_manager_popup_entry_form_inspect_list {

@@ -248,7 +267,7 @@
248	267	}
249	268
250	269	#completion_prompt_manager_footer_append_prompt {
251	270	font-size: 16px1em;
252	271	}
253	272
254	273	#prompt-manager-export-format-popup {

     justify-content: space-between;
+}
 -#prompt-manager-export-format-popup span {
 -    font-size: 16px;
 -}
+-
 @media screen and (max-width: 412px) {
     #completion_prompt_manager_popup {
         max-width: 100%;

         margin-left: 0.5em;
+    }
+}
++
 +.completion_prompt_manager_popup_entry_form_control:has(#completion_prompt_manager_popup_entry_form_prompt:disabled)>div:first-child::after {
 +    content: 'The content of this prompt is pulled from elsewhere and cannot be edited here.';
 +    display: block;
 +    width: 100%;
 +    font-weight: 600;
 +    text-align: center;
 +}
++
 +.completion_prompt_manager_popup_entry_form_control #completion_prompt_manager_popup_entry_form_prompt:disabled {
 +    visibility: hidden;
 +}

public/css/world-info.css+4 -0 Viewed

     align-self: center;
     width: 100%;
+}
++
 +.world_entry:has(input[name="delay_until_recursion"]:not(:checked)) .world_entry_form_control:has(input[name="delayUntilRecursionLevel"]) {
 +    display: none;
 +}

public/img/down-arrow.svg+3 -0 Viewed

 +<svg xmlns="http://www.w3.org/2000/svg" width="10" height="7">
 +    <polygon points="0,0 10,0 5,7" fill="#888888" />
 +</svg>

public/img/user-default.png+0 -0 Viewed

Binary file

public/index.html+437 -342 Viewed

                                         <option value="gui" data-i18n="Default">Default</option>
                                     </select>
                                     <div class="flex-container marginLeft5 ">
                                         <input type="file" hidden data-preset-manager-file="novel" accept=".json, .settings, .preset">
                                         <i data-preset-manager-update="novel" class="menu_button fa-solid fa-save" title="Update current preset" data-i18n="[title]Update current preset"></i>
                                         <i data-preset-manager-new="novel" class="menu_button fa-solid fa-file-circle-plus" title="Save preset as" data-i18n="[title]Save preset as"></i>
                                         <i data-preset-manager-import="novel" class="menu_button fa-solid fa-file-import" title="Import preset" data-i18n="[title]Import preset"></i>

                                     </div>
                                 </div>
                                 <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Min P">
 +                                        Min P
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="min_p_novel" name="volume" min="0" max="1" step="0.001">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="1" step="0.001" data-for="min_p_novel" id="min_p_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
                                     <div class="range-block-title" data-i18n="TFS">
                                         TFS
                                     </div>

                                     </div>
                                 </div>
                                 <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Top P">
 +                                        Top P
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="top_p_novel" name="volume" min="0" max="1" step="0.001">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="1" step="0.001" data-for="top_p_novel" id="top_p_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Top A">
 +                                        Top A
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="top_a_novel" name="volume" min="0" max="1" step="0.001">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="1" step="0.001" data-for="top_a_novel" id="top_a_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Top K">
 +                                        Top K
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="top_k_novel" name="volume" min="0" max="300" step="1">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="300" step="1" data-for="top_k_novel" id="top_k_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Mirostat Tau">
 +                                        Mirostat Tau
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="mirostat_tau_novel" name="volume" min="0" max="6" step="0.01">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="6" step="0.01" data-for="mirostat_tau_novel" id="mirostat_tau_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Mirostat LR">
 +                                        Mirostat LR
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="mirostat_lr_novel" name="volume" min="0" max="1" step="0.01">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="1" step="0.01" data-for="mirostat_lr_novel" id="mirostat_lr_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Typical P">
 +                                        Typical P
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="typical_p_novel" name="volume" min="0" max="1" step="0.001">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="1" step="0.001" data-for="typical_p_novel" id="typical_p_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Linear">
 +                                        Linear
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="math1_temp_novel" name="volume" min="0" max="1.5" step="0.01">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="1.5" step="0.01" data-for="math1_temp_novel" id="math1_temp_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Quad">
 +                                        Quad
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="math1_quad_novel" name="volume" min="0" max="0.4" step="0.01">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="0" max="0.4" step="0.01" data-for="math1_quad_novel" id="math1_quad_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Conf">
 +                                        Conf
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="math1_quad_entropy_scale_novel" name="volume" min="-0.4" max="0.4" step="0.01">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="-0.4" max="0.4" step="0.01" data-for="math1_quad_entropy_scale_novel" id="math1_quad_entropy_scale_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title" data-i18n="Min Length">
 +                                        Min Length
 +                                    </div>
 +                                    <div class="range-block-range-and-counter">
 +                                        <div class="range-block-range">
 +                                            <input type="range" id="min_length_novel" name="volume" min="1" max="150" step="1">
 +                                        </div>
 +                                        <div class="range-block-counter">
 +                                            <input type="number" min="1" max="150" step="1" data-for="min_length_novel" id="min_length_counter_novel">
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
                                     <div class="range-block-title" data-i18n="Phrase Repetition Penalty">
                                         Phrase Repetition Penalty
                                     </div>

                                         <option value="very_aggressive" data-i18n="Very aggressive">Very aggressive</option>
                                     </select>
                                 </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title openai_restorable">
 +                                        <span data-i18n="Preamble">Preamble</span>
 +                                        <div id="nai_preamble_restore" title="Restore default prompt" data-i18n="[title]Restore default prompt" class="right_menu_button">
 +                                            <div class="fa-solid fa-clock-rotate-left "></div>
 +                                        </div>
 +                                    </div>
 +                                    <div class="toggle-description justifyLeft" data-i18n="Use style tags to modify the writing style of the output.">
 +                                        Use style tags to modify the writing style of the output.
 +                                    </div>
 +                                    <div class="wide100p">
 +                                        <textarea id="nai_preamble_textarea" class="text_pole textarea_compact" name="nai_preamble" rows="2" placeholder=""></textarea>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div class="range-block-title justifyLeft">
 +                                        <span data-i18n="Banned Tokens">Banned Tokens</span>
 +                                    </div>
 +                                    <div class="toggle-description justifyLeft" data-i18n="Sequences you don't want to appear in the output. One per line.">
 +                                        Sequences you don't want to appear in the output. One per line. Text or [token ids].
 +                                    </div>
 +                                    <div class="wide100p">
 +                                        <textarea id="nai_banned_tokens" class="text_pole textarea_compact" name="nai_banned_tokens" rows="3" placeholder="Example:&#10;some text&#10;[42, 69, 1337]"></textarea>
 +                                    </div>
 +                                </div>
 +                                <div class="range-block">
 +                                    <div id="logit_bias_novel" class="range-block-title title_restorable">
 +                                        <span data-i18n="Logit Bias">Logit Bias</span>
 +                                        <div id="novelai_logit_bias_new_entry" class="menu_button menu_button_icon">
 +                                            <i class="fa-xs fa-solid fa-plus"></i>
 +                                            <small data-i18n="Add">Add</small>
 +                                        </div>
 +                                    </div>
 +                                    <div class="toggle-description justifyLeft" data-i18n="Helps to ban or reenforce the usage of certain words">
 +                                        Helps to ban or reinforce the usage of certain tokens.
 +                                    </div>
 +                                    <div class="flex-container flexFlowColumn wide100p">
 +                                        <div class="logit_bias_list"></div>
 +                                    </div>
 +                                </div>
                             </div>
                             <div id="range_block_openai">
                                 <div class="range-block">

                                 </div>
                             </div><!-- end of kobold settings-->
                             <div id="novel_api-settings">
 -                                <div class="range-block">
 -                                    <div class="range-block-title openai_restorable">
 -                                        <span data-i18n="Preamble">Preamble</span>
 -                                        <div id="nai_preamble_restore" title="Restore default prompt" data-i18n="[title]Restore default prompt" class="right_menu_button">
 -                                            <div class="fa-solid fa-clock-rotate-left "></div>
 -                                        </div>
 -                                    </div>
 -                                    <div class="toggle-description justifyLeft" data-i18n="Use style tags to modify the writing style of the output.">
 -                                        Use style tags to modify the writing style of the output.
 -                                    </div>
 -                                    <div class="wide100p">
 -                                        <textarea id="nai_preamble_textarea" class="text_pole textarea_compact" name="nai_preamble" rows="2" placeholder=""></textarea>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title justifyLeft">
 -                                        <span data-i18n="Banned Tokens">Banned Tokens</span>
 -                                    </div>
 -                                    <div class="toggle-description justifyLeft" data-i18n="Sequences you don't want to appear in the output. One per line.">
 -                                        Sequences you don't want to appear in the output. One per line. Text or [token ids].
 -                                    </div>
 -                                    <div class="wide100p">
 -                                        <textarea id="nai_banned_tokens" class="text_pole textarea_compact" name="nai_banned_tokens" rows="3" placeholder="Example:&#10;some text&#10;[42, 69, 1337]"></textarea>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div id="logit_bias_novel" class="range-block-title title_restorable">
 -                                        <span data-i18n="Logit Bias">Logit Bias</span>
 -                                        <div id="novelai_logit_bias_new_entry" class="menu_button menu_button_icon">
 -                                            <i class="fa-xs fa-solid fa-plus"></i>
 -                                            <small data-i18n="Add">Add</small>
 -                                        </div>
 -                                    </div>
 -                                    <div class="toggle-description justifyLeft" data-i18n="Helps to ban or reenforce the usage of certain words">
 -                                        Helps to ban or reinforce the usage of certain tokens.
 -                                    </div>
 -                                    <div class="flex-container flexFlowColumn wide100p">
 -                                        <div class="logit_bias_list"></div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <hr>
 -                                    <div class="range-block-title justifyLeft" data-i18n="CFG Scale">
 -                                        CFG Scale
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="cfg_scale_novel" name="volume" min="1" max="3" step="0.05">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="1" max="3" step="0.05" data-for="cfg_scale_novel" id="cfg_scale_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title justifyLeft">
 -                                        <span data-i18n="Negative Prompt">Negative Prompt</span>
 -                                    </div>
 -                                    <div class="wide100p">
 -                                        <textarea id="nai_cfg_uc" class="text_pole textarea_compact" name="cfg_uc" rows="2" data-i18n="[placeholder]Add text here that would make the AI generate things you don't want in your outputs." placeholder="Add text here that would make the AI generate things you don't want in your outputs."></textarea>
 -                                    </div>
 -                                    <small class="margin-bot-10px" data-i18n="Used if CFG Scale is unset globally, per chat or character">
 -                                        Used if CFG Scale is unset globally, per chat or character
 -                                    </small>
 -                                    <hr>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Top P">
 -                                        Top P
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="top_p_novel" name="volume" min="0" max="1" step="0.001">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="0" max="1" step="0.001" data-for="top_p_novel" id="top_p_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Top A">
 -                                        Top A
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="top_a_novel" name="volume" min="0" max="1" step="0.001">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="0" max="1" step="0.001" data-for="top_a_novel" id="top_a_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Top K">
 -                                        Top K
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="top_k_novel" name="volume" min="0" max="300" step="1">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="0" max="300" step="1" data-for="top_k_novel" id="top_k_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Mirostat Tau">
 -                                        Mirostat Tau
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="mirostat_tau_novel" name="volume" min="0" max="6" step="0.01">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="0" max="6" step="0.01" data-for="mirostat_tau_novel" id="mirostat_tau_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Mirostat LR">
 -                                        Mirostat LR
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="mirostat_lr_novel" name="volume" min="0" max="1" step="0.01">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="0" max="1" step="0.01" data-for="mirostat_lr_novel" id="mirostat_lr_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Typical P">
 -                                        Typical P
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="typical_p_novel" name="volume" min="0" max="1" step="0.001">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="0" max="1" step="0.001" data-for="typical_p_novel" id="typical_p_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
 -                                <div class="range-block">
 -                                    <div class="range-block-title" data-i18n="Min Length">
 -                                        Min Length
 -                                    </div>
 -                                    <div class="range-block-range-and-counter">
 -                                        <div class="range-block-range">
 -                                            <input type="range" id="min_length_novel" name="volume" min="1" max="150" step="1">
 -                                        </div>
 -                                        <div class="range-block-counter">
 -                                            <input type="number" min="1" max="150" step="1" data-for="min_length_novel" id="min_length_counter_novel">
 -                                        </div>
 -                                    </div>
 -                                </div>
                                 <div class="range-block flexFlowColumn">
                                     <div class="range-block-title">
                                         <span data-i18n="Samplers Order">Samplers Order</span>

                                             <small>5</small>
                                             <div class="toggle_button right_menu_button"></div>
                                         </div>
 -                                        <div data-id="6">
 +                                        <!-- 6 and 7 were removed samplers. -->
 -                                            <span data-i18n="CFG">CFG</span>
 -                                            <small>6</small>
 -                                            <div class="toggle_button right_menu_button"></div>
 -                                        </div>
 -                                        <!-- Yes, there is no 7. It was a removed Top G sampling. RIP. -->
                                         <div data-id="8">
                                             <span data-i18n="Mirostat">Mirostat</span>
                                             <small>8</small>
                                             <div class="toggle_button right_menu_button"></div>
                                         </div>
 +                                        <div data-id="9">
 +                                            <span data-i18n="Unified Sampling">Unified Sampling</span>
 +                                            <small>9</small>
 +                                            <div class="toggle_button right_menu_button"></div>
 +                                        </div>
 +                                        <div data-id="10">
 +                                            <span data-i18n="Min P">Min P</span>
 +                                            <small>10</small>
 +                                            <div class="toggle_button right_menu_button"></div>
 +                                        </div>
                                     </div>
                                 </div>
                             </div><!-- end of novel settings-->

                                         </div>
                                     </div>
                                     <div data-tg-type="koboldcpp, aphrodite" id="xtc_block" class="wide100p">
                                         <h4 class="wide100p textAlignCenter">
                                             <label data-i18n="Exclude Top Choices (XTC)">Exclude Top Choices (XTC)</label>
                                             <a href="https://github.com/oobabooga/text-generation-webui/pull/6335" target="_blank">

                                             </div>
                                         </div>
                                     </div>
                                     <div data-tg-type="ooba, mancer, koboldcpp, tabby, llamacpp, aphrodite" id="dynatemp_block_ooba" class="wide100p">
                                         <h4 class="wide100p textAlignCenter">
                                             <div class="flex-container alignitemscenter justifyCenter">
                                                 <div class="checkbox_label" for="dynatemp_textgenerationwebui">

                             <select id="model_novel_select">
                                 <option value="clio-v1">Clio</option>
                                 <option value="kayra-v1">Kayra</option>
 +                                <option value="llama-3-erato-v1">Erato</option>
                             </select>
                             <div class="flex-container">
                                 <div id="api_button_novel" class="api_button menu_button menu_button_icon" type="submit" data-i18n="Connect">Connect</div>

                                         <option value="gemini-1.5-pro-exp-0827">Gemini 1.5 Pro Experiment 2024-08-27</option>
                                         <option value="gemini-1.5-pro-latest">Gemini 1.5 Pro [latest]</option>
                                         <option value="gemini-1.5-pro-001">Gemini 1.5 Pro [001]</option>
 +                                        <option value="gemini-1.5-pro-002">Gemini 1.5 Pro [002]</option>
                                         <option value="gemini-1.5-flash-exp-0827">Gemini 1.5 Flash Experiment 2024-08-27</option>
                                         <option value="gemini-1.5-flash-8b-exp-0827">Gemini 1.5 Flash 8B Experiment 2024-08-27</option>
 +                                        <option value="gemini-1.5-flash-8b-exp-0924">Gemini 1.5 Flash 8B Experiment 2024-09-24</option>
                                         <option value="gemini-1.5-flash-latest">Gemini 1.5 Flash [latest]</option>
                                         <option value="gemini-1.5-flash-001">Gemini 1.5 Flash [001]</option>
 +                                        <option value="gemini-1.5-flash-002">Gemini 1.5 Flash [002]</option>
                                         <option value="gemini-1.0-pro-latest">Gemini 1.0 Pro [latest]</option>
                                         <option value="gemini-1.0-pro-001">Gemini 1.0 Pro (Tuning) [001]</option>
                                         <option value="gemini-1.0-pro-vision-latest">Gemini 1.0 Pro Vision [latest]</option>

                                         <option value="mistral-large-latest">mistral-large-latest</option>
                                         <option value="codestral-latest">codestral-latest</option>
                                         <option value="codestral-mamba-latest">codestral-mamba-latest</option>
 +                                        <option value="pixtral-latest">pixtral-latest</option>
                                     </optgroup>
                                     <optgroup label="Sub-versions">
                                         <option value="open-mistral-nemo-2407">open-mistral-nemo-2407</option>

                                         <option value="mistral-tiny-2312">mistral-tiny-2312</option>
                                         <option value="mistral-small-2312">mistral-small-2312</option>
                                         <option value="mistral-small-2402">mistral-small-2402</option>
 +                                        <option value="mistral-small-2409">mistral-small-2409</option>
                                         <option value="mistral-medium-2312">mistral-medium-2312</option>
                                         <option value="mistral-large-2402">mistral-large-2402</option>
                                         <option value="mistral-large-2407">mistral-large-2407</option>
                                         <option value="codestral-2405">codestral-2405</option>
                                         <option value="codestral-mamba-2407">codestral-mamba-2407</option>
 +                                        <option value="pixtral-12b-2409">pixtral-12b-2409</option>
                                     </optgroup>
                                 </select>
                             </div>

                 <div class="drawer-icon fa-solid fa-font fa-fw closedIcon" title="AI Response Formatting" data-i18n="[title]AI Response Formatting"></div>
             </div>
             <div id="AdvancedFormatting" class="drawer-content">
                 <h3div class="margin0" dataflex-i18n="Advancedcontainer FormattingalignItemsBaseline">
 +                    <h3 class="margin0 flex1" data-i18n="Advanced Formatting">
                         Advanced Formatting
                     </h3>
 +                    <div class="flex-container">
 +                        <input id="af_master_import_file" type="file" hidden accept=".json" class="displayNone">
 +                        <div id="af_master_import" class="menu_button menu_button_icon" title="Import Advanced Formatting settings&#10;&#10;You can also provide legacy files for Instruct and Context templates." data-i18n="[title]Import Advanced Formatting settings">
 +                            <i class="fa-solid fa-file-import"></i>
 +                            <span data-i18n="Master Import">Master Import</span>
 +                        </div>
 +                        <div id="af_master_export" class="menu_button menu_button_icon" title="Export Advanced Formatting settings" data-i18n="[title]Export Advanced Formatting settings">
 +                            <i class="fa-solid fa-file-export"></i>
 +                            <span data-i18n="Master Export">Master Export</span>
 +                        </div>
 +                    </div>
 +                </div>
                 <div class="flex-container spaceEvenly">
                     <div id="ContextSettings" class="flex-container flexNoGap flexFlowColumn flex1">
                         <div>

                                     </a>
                                 </div>
                             </h4>
 +                            <div class="flex-container" title="Select your current Context Template" data-i18n="[title]Select your current Context Template">
 +                                <select id="context_presets" data-preset-manager-for="context" class="flex1 text_pole"></select>
                                 <div class="flex-container justifyCenter">
                                     <input type="file" hidden data-preset-manager-file="context" accept=".json, .settings">
 -                                <i id="context_set_default" class="menu_button fa-solid fa-heart" title="Auto-select this template for Instruct Mode." data-i18n="[title]Auto-select this template for Instruct Mode"></i>
                                     <i data-preset-manager-update="context" class="menu_button fa-solid fa-save" title="Update current template" data-i18n="[title]Update current template"></i>
                                     <i data-preset-manager-new="context" class="menu_button fa-solid fa-file-circle-plus" title="Save template as" data-i18n="[title]Save template as"></i>
                                                                     <i data-preset-manager-import="context" class="displayNone menu_button fa-solid fa-file-import" title="Import template" data-i18n="[title]Import template"></i>
                                                                     <i data-preset-manager-export="context" class="displayNone menu_button fa-solid fa-file-export" title="Export template" data-i18n="[title]Export template"></i>
                                     <i data-preset-manager-restore="context" class="menu_button fa-solid fa-recycle" title="Restore current template" data-i18n="[title]Restore current template"></i>
                                     <i id="context_delete_preset" data-preset-manager-delete="context" class="menu_button fa-solid fa-trash-can" title="Delete the template" data-i18n="[title]Delete the template"></i>
                                 </div>
 -                            <div class="flex-container" title="Select your current Context Template" data-i18n="[title]Select your current Context Template">
 -                                <select id="context_presets" data-preset-manager-for="context" class="flex1 text_pole"></select>
                             </div>
                             <div>
                                 <label for="context_story_string" class="flex-container">

                                         <span data-i18n="Context Formatting">
                                             Context Formatting
                                         </span>
 -                                        <small data-i18n="(Saves to Template)">
 -                                            (Saves to Template)
 -                                        </small>
                                     </h4>
                                     <label class="checkbox_label" for="always-force-name2-checkbox">

                                             Trim Incomplete Sentences
                                         </small>
                                     </label>
 -                                    <!-- Add margin since this is a child of above -->
 -                                    <label class="checkbox_label indent20p" for="include_newline_checkbox">
 -                                        <input id="include_newline_checkbox" type="checkbox" />
 -                                        <small data-i18n="Include Newline">Include Newline</small>
 -                                    </label>
                                     <label class="checkbox_label" title="Add Chat Start and Example Separator to a list of stopping strings." data-i18n="[title]Add Chat Start and Example Separator to a list of stopping strings.">
                                         <input id="context_use_stop_strings" type="checkbox" />
                                         <small data-i18n="Separators as Stop Strings">Separators as Stop Strings</small>
                                     </label>
                                     <label class="checkbox_label" title="Add Character and User names to a list of stopping strings." data-i18n="[title]Add Character and User names to a list of stopping strings.">
                                         <input id="context_names_as_stop_strings" type="checkbox" />
                                         <small data-i18n="Names as Stop Strings">Names as Stop Strings</small>
                                     </label>
                                 </div>
                                 <label class="checkbox_label" title="Includes Post-History Instructions at the end of the prompt, if defined in the character card AND ''Prefer Char. Instructions'' is enabled.&#10;THIS IS NOT RECOMMENDED FOR TEXT COMPLETION MODELS, CAN LEAD TO BAD OUTPUT." data-i18n="[title]context_allow_post_history_instructions">
                                     <input id="context_allow_jailbreak" type="checkbox" />
                                     <small data-i18n="Allow Post-History Instructions">Allow Post-History Instructions</small>
 -                                </label>
 -                            </div>
 -                            <div>
 -                                <h4 class="range-block-title justifyLeft standoutHeader">
 -                                    <span data-i18n="Custom Stopping Strings">
 -                                        Custom Stopping Strings
 -                                    </span>
 -                                    <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#custom-stopping-strings" class="notes-link" target="_blank">
 -                                        <span class="fa-solid fa-circle-question note-link-span"></span>
 -                                    </a>
 -                                </h4>
 -                                <div>
 -                                    <small>
 -                                        <span data-i18n="JSON serialized array of strings">JSON serialized array of strings</span>
 -                                        <i class="fa-solid fa-question-circle opacity50p" title="e.g: [&quot;Ford&quot;, &quot;BMW&quot;, &quot;Fiat&quot;]"></i>
 -                                    </small>
 -                                </div>
 -                                <div>
 -                                    <textarea id="custom_stopping_strings" class="text_pole textarea_compact monospace autoSetHeight"></textarea>
 -                                </div>
 -                                <label class="checkbox_label" for="custom_stopping_strings_macro">
 -                                    <input id="custom_stopping_strings_macro" type="checkbox" checked>
 -                                    <small data-i18n="Replace Macro in Custom Stopping Strings">
 -                                        Replace Macro in Custom Stopping Strings
 -                                    </small>
                                 </label>
                             </div>
                         </div>

                                     </a>
                                 </div>
                                 <div class="flex-container">
 -                                    <label for="instruct_enabled" class="checkbox_label flex1" title="Enable Instruct Mode" data-i18n="[title]instruct_enabled">
 -                                        <input id="instruct_enabled" type="checkbox" style="display:none;" />
 -                                        <small><i class="fa-solid fa-power-off menu_button margin0"></i></small>
 -                                    </label>
                                     <label for="instruct_bind_to_context" class="checkbox_label flex1" title="Bind to Context&#10If enabled, Context templates will be automatically selected based on selected Instruct template name or by preference." data-i18n="[title]instruct_bind_to_context">
                                         <input id="instruct_bind_to_context" type="checkbox" style="display:none;" />
                                         <small><i class="fa-solid fa-link menu_button margin0"></i></small>
                                     </label>
 +                                    <label for="instruct_enabled" class="checkbox_label flex1" title="Enable Instruct Mode" data-i18n="[title]instruct_enabled">
 +                                        <input id="instruct_enabled" type="checkbox" style="display:none;" />
 +                                        <small><i class="fa-solid fa-power-off menu_button margin0"></i></small>
 +                                    </label>
                                 </div>
                             </h4>
++
 +                            <div class="flex-container" title="Select your current Instruct Template" data-i18n="[title]Select your current Instruct Template">
 +                                <select id="instruct_presets" data-preset-manager-for="instruct" class="flex1 text_pole"></select>
                                 <div class="flex-container margin0 justifyCenter">
                                     <input type="file" hidden data-preset-manager-file="instruct" accept=".json, .settings">
 -                                <i id="instruct_set_default" class="menu_button fa-solid fa-heart" title="Auto-select this template on API connection." data-i18n="[title]Auto-select this template on API connection"></i>
                                     <i data-preset-manager-update="instruct" class="menu_button fa-solid fa-save" title="Update current template" data-i18n="[title]Update current template"></i>
                                     <i data-preset-manager-new="instruct" class="menu_button fa-solid fa-file-circle-plus" title="Save template as" data-i18n="[title]Save template as"></i>
                                                                     <i data-preset-manager-import="instruct" class="displayNone menu_button fa-solid fa-file-import" title="Import template" data-i18n="[title]Import template"></i>
                                                                     <i data-preset-manager-export="instruct" class="displayNone menu_button fa-solid fa-file-export" title="Export template" data-i18n="[title]Export template"></i>
                                     <i data-preset-manager-restore="instruct" class="menu_button fa-solid fa-recycle" title="Restore current template" data-i18n="[title]Restore current template"></i>
                                     <i data-preset-manager-delete="instruct" class="menu_button fa-solid fa-trash-can" title="Delete template" data-i18n="[title]Delete template"></i>
                                 </div>
+-
 -                            <div class="flex-container" title="Select your current Instruct Template" data-i18n="[title]Select your current Instruct Template">
 -                                <select id="instruct_presets" data-preset-manager-for="instruct" class="flex1 text_pole"></select>
                             </div>
                             <label>
                                 <small>

                                 <input type="text" id="instruct_activation_regex" class="text_pole textarea_compact" placeholder="e.g. /llama(-)?[3|3.1]/i">
                             </div>
                             <div>
 -                                <label for="instruct_system_prompt" class="flex-container">
 -                                    <small data-i18n="System Prompt">System Prompt</small>
 -                                    <i class="editor_maximize fa-solid fa-maximize right_menu_button" data-for="instruct_system_prompt" title="Expand the editor" data-i18n="[title]Expand the editor"></i>
 -                                </label>
 -                                <textarea id="instruct_system_prompt" class="text_pole textarea_compact autoSetHeight"></textarea>
 -                            </div>
+-
 -                            <div>
                                 <label for="instruct_wrap" class="checkbox_label">
                                     <input id="instruct_wrap" type="checkbox" />
                                     <small data-i18n="Wrap Sequences with Newline">Wrap Sequences with Newline</small>

                                     <input id="instruct_skip_examples" type="checkbox" />
                                     <small data-i18n="Skip Example Dialogues Formatting">Skip Example Dialogues Formatting</small>
                                 </label>
 -                                <label for="instruct_names" class="checkbox_label">
 -                                    <input id="instruct_names" type="checkbox" />
 -                                    <small data-i18n="Include Names">Include Names</small>
 -                                </label>
 -                                <label for="instruct_names_force_groups" class="checkbox_label indent20p">
 -                                    <input id="instruct_names_force_groups" type="checkbox" />
 -                                    <small data-i18n="Force for Groups and Personas">Force for Groups and Personas</small>
 -                                </label>
 -                            </div>
 -                        </div>
 -                        <div name="tokenizerSettingsBlock">
 -                            <div name="tokenizerSelectorBlock">
 -                                <h4 class="standoutHeader"><span data-i18n="Tokenizer">Tokenizer</span>
 -                                    <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#tokenizer" class="notes-link" target="_blank">
 -                                        <span class="fa-solid fa-circle-question note-link-span"></span>
 -                                    </a>
 -                                </h4>
 -                                <select id="tokenizer">
 -                                    <option value="99">Best match (recommended)</option>
 -                                    <option value="0">None / Estimated</option>
 -                                    <option value="1">GPT-2</option>
 -                                    <!-- Option #2 was a legacy GPT-2/3 tokenizer -->
 -                                    <option value="3">Llama 1/2</option>
 -                                    <option value="12">Llama 3</option>
 -                                    <option value="13">Gemma / Gemini</option>
 -                                    <option value="14">Jamba</option>
 -                                    <option value="15">Qwen2</option>
 -                                    <option value="16">Command-R</option>
 -                                    <option value="4">NerdStash (NovelAI Clio)</option>
 -                                    <option value="5">NerdStash v2 (NovelAI Kayra)</option>
 -                                    <option value="7">Mistral</option>
 -                                    <option value="8">Yi</option>
 -                                    <option value="11">Claude 1/2</option>
 -                                    <option value="6">API (WebUI / koboldcpp)</option>
 -                                </select>
 -                            </div>
 -                            <div class="range-block flex-container flexnowrap" name="tokenPaddingBlock">
 -                                <div class="range-block-title justifyLeft">
 -                                    <small data-i18n="Token Padding" class="flex-container">Token Padding
 -                                        <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#token-padding" class="notes-link" target="_blank">
 -                                            <span class="fa-solid fa-circle-question note-link-span"></span>
 -                                        </a>
 -                                    </small>
 -                                </div>
 -                                <input id="token_padding" class="text_pole textarea_compact" type="number" min="-2048" max="2048" />
 -                            </div>
 -                        </div>
 -                        <div>
 -                            <h4 class="standoutHeader" data-i18n="Miscellaneous">Miscellaneous</h4>
 -                            <div>
 -                                <small>
 -                                    <span data-i18n="Non-markdown strings">
 -                                        Non-markdown strings
 -                                    </span>
 -                                </small>
 -                                <div>
 -                                    <input id="markdown_escape_strings" class="text_pole textarea_compact" type="text" data-i18n="[placeholder]comma delimited,no spaces between" placeholder="comma delimited,no spaces between" />
 -                                </div>
 -                            </div>
+-
 -                            <div name="startReplyWithBlock">
 -                                <div>
 -                                    <small>
 -                                        <span data-i18n="Start Reply With">
 -                                            Start Reply With
 -                                        </span>
 -                                    </small>
                                 <div>
 -                                        <textarea id="start_reply_with" class="text_pole textarea_compact autoSetHeight"></textarea>
 +                                    <small data-i18n="Include Names">
 -                                    </div>
 +                                        Include Names
 -                                    <label class="checkbox_label" for="chat-show-reply-prefix-checkbox">
 -                                        <input id="chat-show-reply-prefix-checkbox" type="checkbox" />
 -                                        <small data-i18n="Show reply prefix in chat">
 -                                            Show reply prefix in chat
                                     </small>
 -                                    </label>
 +                                    <select id="instruct_names_behavior">
 -                                </div>
 +                                        <option value="none" data-i18n="Never">Never</option>
 +                                        <option value="force" data-i18n="Groups and Past Personas">Groups and Past Personas</option>
 +                                        <option value="always" data-i18n="Always">Always</option>
 +                                    </select>
                                 </div>
                             </div>
                         </div>
                                             <div id="InstructSequencesColumn" class="flex-container flexNoGapwide100p flexFlowColumn flex1">
 -                        <div class="wide100p flexFlowColumn">
                             <h4 class="standoutHeader title_restorable">
                                 <b>
                                     <span data-i18n="Instruct Sequences">
                                         Instruct Sequences
                                     </span>
 -                                    <small data-i18n="(Saves to Template)">
 -                                        (Saves to Template)
 -                                    </small>
                                 </b>
                             </h4>
 -                            <div class="flex-container">
 +                            <!-- We keep one auto-open so the user would know what is going on in the picked template -->
 -                                <div class="flexAuto" title="Inserted before a System prompt." data-i18n="[title]Inserted before a System prompt.">
 +                            <details open>
 -                                    <label for="instruct_system_sequence_prefix">
 +                                <summary>User Message Sequences</summary>
 -                                        <small data-i18n="System Prompt Prefix">System Prompt Prefix</small>
 -                                    </label>
 -                                    <div>
 -                                        <textarea id="instruct_system_sequence_prefix" class="text_pole textarea_compact autoSetHeight"></textarea>
 -                                    </div>
 -                                </div>
 -                                <div class="flexAuto" title="Inserted after a System prompt." data-i18n="[title]Inserted after a System prompt.">
 -                                    <label for="instruct_system_sequence_suffix">
 -                                        <small data-i18n="System Prompt Suffix">System Prompt Suffix</small>
 -                                    </label>
 -                                    <div>
 -                                        <textarea id="instruct_system_sequence_suffix" class="text_pole wide100p textarea_compact autoSetHeight"></textarea>
 -                                    </div>
 -                                </div>
 -                            </div>
                                 <div class="flex-container">
                                     <div class="flexAuto" title="Inserted before a User message and as a last prompt line when impersonating." data-i18n="[title]Inserted before a User message and as a last prompt line when impersonating.">
                                         <small data-i18n="User Prefix">User Message Prefix</small>

                                         <textarea id="instruct_input_suffix" class="text_pole wide100p textarea_compact autoSetHeight"></textarea>
                                     </div>
                                 </div>
 +                            </details>
 +                            <details open>
 +                                <summary>Assistant Message Sequences</summary>
                                 <div class="flex-container">
                                     <div class="flexAuto" title="Inserted before an Assistant message and as a last prompt line when generating an AI reply." data-i18n="[title]Inserted before an Assistant message and as a last prompt line when generating an AI reply.">
                                         <small data-i18n="Assistant Prefix">Assistant Message Prefix</small>

                                         <textarea id="instruct_output_suffix" class="text_pole wide100p textarea_compact autoSetHeight"></textarea>
                                     </div>
                                 </div>
 +                            </details>
 +                            <details>
 +                                <summary>System Message Sequences</summary>
                                 <div class="flex-container">
                                     <div class="flexAuto" id="instruct_system_sequence_block" title="Inserted before a System (added by slash commands or extensions) message." data-i18n="[title]Inserted before a System (added by slash commands or extensions) message.">
                                         <small data-i18n="System Prefix">System Message Prefix</small>

                                         <small data-i18n="System same as User">System same as User</small>
                                     </label>
                                 </div>
+-
 +                            </details>
 -                            <h5 class="textAlignCenter" data-i18n="Misc. Sequences">
 +                            <details>
 -                                Misc. Sequences
 +                                <summary>System Prompt Sequences</summary>
 -                            </h5>
 +                                <div class="flex-container">
 +                                    <div class="flexAuto" title="Inserted before a System prompt." data-i18n="[title]Inserted before a System prompt.">
 +                                        <label for="instruct_system_sequence_prefix">
 +                                            <small data-i18n="System Prompt Prefix">System Prompt Prefix</small>
 +                                        </label>
 +                                        <div>
 +                                            <textarea id="instruct_system_sequence_prefix" class="text_pole textarea_compact autoSetHeight"></textarea>
 +                                        </div>
 +                                    </div>
 +                                    <div class="flexAuto" title="Inserted after a System prompt." data-i18n="[title]Inserted after a System prompt.">
 +                                        <label for="instruct_system_sequence_suffix">
 +                                            <small data-i18n="System Prompt Suffix">System Prompt Suffix</small>
 +                                        </label>
 +                                        <div>
 +                                            <textarea id="instruct_system_sequence_suffix" class="text_pole wide100p textarea_compact autoSetHeight"></textarea>
 +                                        </div>
 +                                    </div>
 +                                </div>
 +                            </details>
 +                            <details>
 +                                <summary data-i18n="Misc. Sequences">Misc. Sequences</summary>
                                 <div class="flex-container">
                                     <div class="flexAuto" title="Inserted before the first Assistant's message." data-i18n="[title]Inserted before the first Assistant's message.">
                                         <small data-i18n="First Assistant Prefix">First Assistant Prefix</small>

                                         <textarea id="instruct_user_alignment_message" class="text_pole textarea_compact autoSetHeight"></textarea>
                                     </div>
                                 </div>
 +                            </details>
 +                        </div>
 +                    </div>
 +                    <div id="SystemPromptColumn" class="flex-container flexNoGap flexFlowColumn flex1">
 +                        <div id="SystemPromptBlock">
 +                            <h4 class="standoutHeader title_restorable justifySpaceBetween">
 +                                <div class="flex-container">
 +                                    <span data-i18n="System Prompt">System Prompt</span>
 +                                    <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#system-prompt" class="notes-link" target="_blank">
 +                                        <span class="fa-solid fa-circle-question note-link-span"></span>
 +                                    </a>
 +                                </div>
 +                                <div class="flex-container">
 +                                    <label for="sysprompt_enabled" class="checkbox_label flex1" title="Enable System Prompt" data-i18n="[title]sysprompt_enabled">
 +                                        <input id="sysprompt_enabled" type="checkbox" style="display:none;" />
 +                                        <small><i class="fa-solid fa-power-off menu_button margin0"></i></small>
 +                                    </label>
 +                                </div>
 +                            </h4>
++
 +                            <div class="flex-container" title="Select your current System Prompt" data-i18n="[title]Select your current System Prompt">
 +                                <select id="sysprompt_select" data-preset-manager-for="sysprompt" class="flex1 text_pole"></select>
 +                                <div class="flex-container margin0 justifyCenter">
 +                                    <input type="file" hidden data-preset-manager-file="sysprompt" accept=".json, .settings">
 +                                    <i data-preset-manager-update="sysprompt" class="menu_button fa-solid fa-save" title="Update current prompt" data-i18n="[title]Update current prompt"></i>
 +                                    <i data-preset-manager-new="sysprompt" class="menu_button fa-solid fa-file-circle-plus" title="Save prompt as" data-i18n="[title]Save prompt as"></i>
 +                                    <i data-preset-manager-import="sysprompt" class="displayNone menu_button fa-solid fa-file-import" title="Import template" data-i18n="[title]Import template"></i>
 +                                    <i data-preset-manager-export="sysprompt" class="displayNone menu_button fa-solid fa-file-export" title="Export template" data-i18n="[title]Export template"></i>
 +                                    <i data-preset-manager-restore="sysprompt" class="menu_button fa-solid fa-recycle" title="Restore current prompt" data-i18n="[title]Restore current prompt"></i>
 +                                    <i data-preset-manager-delete="sysprompt" class="menu_button fa-solid fa-trash-can" title="Delete prompt" data-i18n="[title]Delete prompt"></i>
 +                                </div>
 +                            </div>
++
 +                            <div>
 +                                <label for="sysprompt_content" class="flex-container">
 +                                    <small data-i18n="Prompt Content">Prompt Content</small>
 +                                    <i class="editor_maximize fa-solid fa-maximize right_menu_button" data-for="sysprompt_content" title="Expand the editor" data-i18n="[title]Expand the editor"></i>
 +                                </label>
 +                                <textarea id="sysprompt_content" class="text_pole textarea_compact autoSetHeight"></textarea>
 +                            </div>
 +                        </div>
++
 +                        <div>
 +                            &nbsp;
 +                        </div>
++
 +                        <div>
 +                            <h4 class="range-block-title justifyLeft standoutHeader">
 +                                <span data-i18n="Custom Stopping Strings">
 +                                    Custom Stopping Strings
 +                                </span>
 +                                <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#custom-stopping-strings" class="notes-link" target="_blank">
 +                                    <span class="fa-solid fa-circle-question note-link-span"></span>
 +                                </a>
 +                            </h4>
 +                            <div>
 +                                <small>
 +                                    <span data-i18n="JSON serialized array of strings">JSON serialized array of strings</span>
 +                                    <i class="fa-solid fa-question-circle opacity50p" title="e.g: [&quot;Ford&quot;, &quot;BMW&quot;, &quot;Fiat&quot;]"></i>
 +                                </small>
 +                            </div>
 +                            <div>
 +                                <textarea id="custom_stopping_strings" class="text_pole textarea_compact monospace autoSetHeight"></textarea>
 +                            </div>
 +                            <label class="checkbox_label" for="custom_stopping_strings_macro">
 +                                <input id="custom_stopping_strings_macro" type="checkbox" checked>
 +                                <small data-i18n="Replace Macro in Custom Stopping Strings">
 +                                    Replace Macro in Custom Stopping Strings
 +                                </small>
 +                            </label>
 +                        </div>
++
 +                        <div name="tokenizerSettingsBlock">
 +                            <div name="tokenizerSelectorBlock">
 +                                <h4 class="standoutHeader"><span data-i18n="Tokenizer">Tokenizer</span>
 +                                    <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#tokenizer" class="notes-link" target="_blank">
 +                                        <span class="fa-solid fa-circle-question note-link-span"></span>
 +                                    </a>
 +                                </h4>
 +                                <select id="tokenizer">
 +                                    <option value="99">Best match (recommended)</option>
 +                                    <option value="0">None / Estimated</option>
 +                                    <option value="1">GPT-2</option>
 +                                    <!-- Option #2 was a legacy GPT-2/3 tokenizer -->
 +                                    <option value="3">Llama 1/2</option>
 +                                    <option value="12">Llama 3</option>
 +                                    <option value="13">Gemma / Gemini</option>
 +                                    <option value="14">Jamba</option>
 +                                    <option value="15">Qwen2</option>
 +                                    <option value="16">Command-R</option>
 +                                    <option value="4">NerdStash (NovelAI Clio)</option>
 +                                    <option value="5">NerdStash v2 (NovelAI Kayra)</option>
 +                                    <option value="7">Mistral V1</option>
 +                                    <option value="17">Mistral Nemo</option>
 +                                    <option value="8">Yi</option>
 +                                    <option value="11">Claude 1/2</option>
 +                                    <option value="6">API (WebUI / koboldcpp)</option>
 +                                </select>
 +                            </div>
 +                            <div class="range-block flex-container flexnowrap" name="tokenPaddingBlock">
 +                                <div class="range-block-title justifyLeft">
 +                                    <small data-i18n="Token Padding" class="flex-container">Token Padding
 +                                        <a href="https://docs.sillytavern.app/usage/core-concepts/advancedformatting/#token-padding" class="notes-link" target="_blank">
 +                                            <span class="fa-solid fa-circle-question note-link-span"></span>
 +                                        </a>
 +                                    </small>
 +                                </div>
 +                                <input id="token_padding" class="text_pole textarea_compact" type="number" min="-2048" max="2048" />
 +                            </div>
 +                        </div>
 +                        <div>
 +                            <h4 class="standoutHeader" data-i18n="Miscellaneous">Miscellaneous</h4>
 +                            <div>
 +                                <small>
 +                                    <span data-i18n="Non-markdown strings">
 +                                        Non-markdown strings
 +                                    </span>
 +                                </small>
 +                                <div>
 +                                    <input id="markdown_escape_strings" class="text_pole textarea_compact" type="text" data-i18n="[placeholder]comma delimited,no spaces between" placeholder="comma delimited,no spaces between" />
 +                                </div>
 +                            </div>
++
 +                            <div name="startReplyWithBlock">
 +                                <div>
 +                                    <small>
 +                                        <span data-i18n="Start Reply With">
 +                                            Start Reply With
 +                                        </span>
 +                                    </small>
 +                                    <div>
 +                                        <textarea id="start_reply_with" class="text_pole textarea_compact autoSetHeight"></textarea>
 +                                    </div>
 +                                    <label class="checkbox_label" for="chat-show-reply-prefix-checkbox">
 +                                        <input id="chat-show-reply-prefix-checkbox" type="checkbox" />
 +                                        <small data-i18n="Show reply prefix in chat">
 +                                            Show reply prefix in chat
 +                                        </small>
 +                                    </label>
 +                                </div>
 +                            </div>
                         </div>
                     </div>
                 </div>

                                     <div class="world_entry_form_control flex1">
                                         <small class="textAlignCenter" data-i18n="Case-Sensitive">Case-Sensitive</small>
                                         <select name="caseSensitive" class="text_pole widthNatural margin0">
                                             <option value="null" data-i18n="Use global setting">Use global setting</option>
                                             <option value="true" data-i18n="Yes">Yes</option>
                                             <option value="false" data-i18n="No">No</option>
                                         </select>
                                     </div>
                                     <div class="world_entry_form_control flex1">
                                         <small class="textAlignCenter" data-i18n="Match Whole Words">Match Whole Words</small>
                                         <select name="matchWholeWords" class="text_pole widthNatural margin0">
                                             <option value="null" data-i18n="Use global setting">Use global setting</option>
                                             <option value="true" data-i18n="Yes">Yes</option>
                                             <option value="false" data-i18n="No">No</option>
                                         </select>
                                     </div>
                                     <div class="world_entry_form_control flex1">
                                         <small class="textAlignCenter" data-i18n="Use Group Scoring">Use Group Scoring</small>
                                         <select name="useGroupScoring" class="text_pole widthNatural margin0">
                                             <option value="null" data-i18n="Use global setting">Use global setting</option>
                                             <option value="true" data-i18n="Yes">Yes</option>
                                             <option value="false" data-i18n="No">No</option>
                                         </select>

                                         <small class="textAlignCenter" data-i18n="Automation ID">Automation ID</small>
                                         <input class="text_pole margin0" name="automationId" type="text" placeholder="( None )" data-i18n="[placeholder]( None )">
                                     </div>
 +                                    <div class="world_entry_form_control flex1" title="Defines delay levels for recursive scans.&#13;&#13;Initially, only the first level (smallest number) will match.&#13;Once no matches are found, the next level becomes eligible for matching.&#13;This repeats until all levels are checked.&#13;&#13;Tied to the &quot;Delay until recursion&quot; setting." data-i18n="[title]delay_until_recursion_level">
 +                                        <small class="textAlignCenter">
 +                                            <span data-i18n="Recursion Level">Recursion Level</span>
 +                                            <div class="fa-solid fa-circle-info opacity50p"></div>
 +                                        </small>
 +                                        <input class="text_pole margin0" name="delayUntilRecursionLevel" type="text" placeholder="1">
 +                                    </div>
                                 </div>
                                 <div name="contentAndCharFilterBlock" class="world_entry_thin_controls flex2">
                                     <div class="world_entry_form_control flex1">

                                                     <div>
                                                         <label class="checkbox flex-container alignitemscenter flexNoGap">
                                                             <input type="checkbox" name="exclude_recursion" />
                                                             <span data-i18n="ExcludeNon-recursable from(will recursionnot be activated by another)">
                                                                 Non-recursable (this entry will not be activated by another)
                                                             </span>
                                                         </label>
                                                         <label class="checkbox flex-container alignitemscenter flexNoGap">
                                                             <input type="checkbox" name="prevent_recursion" />
                                                             <span data-i18n="Prevent further recursion (this entry will not activate others)">
                                                                 Prevent further recursion (this entry will not activate others)
                                                             </span>
                                                         </label>
                                                         <label class="checkbox flex-container alignitemscenter flexNoGap">
                                                             <input type="checkbox" name="delay_until_recursion" />
                                                             <span data-i18n="Delay until recursion (this entry can only be activated on recursive checking)">
                                                                 Delay until recursion (this entry can only be activated on recursive checking)
                                                             </span>
                                                         </label>
                                                     </div>

public/script.js+63 -31 Viewed

     proxies,
     loadProxyPresets,
     selected_proxy,
     initOpenaiinitOpenAI,
 } from './scripts/openai.js';
 import {

     selectContextPreset,
 } from './scripts/instruct-mode.js';
 import { initLocales, t, translate } from './scripts/i18n.js';
 import { getFriendlyTokenizerName, getTokenCount, getTokenCountAsync, getTokenizerModel, initTokenizers, saveTokenCache, TOKENIZER_SUPPORTED_KEY } from './scripts/tokenizers.js';
 import {
     user_avatar,
     getUserAvatars,

 import { hideLoader, showLoader } from './scripts/loader.js';
 import { BulkEditOverlay, CharacterContextMenu } from './scripts/BulkEditOverlay.js';
 import { loadFeatherlessModels, loadMancerModels, loadOllamaModels, loadTogetherAIModels, loadInfermaticAIModels, loadOpenRouterModels, loadVllmModels, loadAphroditeModels, loadDreamGenModels, initTextGenModels, loadTabbyModels } from './scripts/textgen-models.js';
 import { appendFileContent, hasPendingFileAttachment, populateFileAttachment, decodeStyleTags, encodeStyleTags, isExternalMediaAllowed, getCurrentEntityId, preserveNeutralChat, restoreNeutralChat } from './scripts/chats.js';
 import { initPresetManager } from './scripts/preset-manager.js';
 import { MacrosParser, evaluateMacros, getLastMessageId } from './scripts/macros.js';
 import { currentUser, setUserControls } from './scripts/user.js';

 import { commonEnumProviders, enumIcons } from './scripts/slash-commands/SlashCommandCommonEnumsProvider.js';
 import { initInputMarkdown } from './scripts/input-md-formatting.js';
 import { AbortReason } from './scripts/util/AbortReason.js';
 +import { initSystemPrompts } from './scripts/sysprompt.js';
 //exporting functions and vars for mods
 export {

     MESSAGE_FILE_EMBEDDED: 'message_file_embedded',
     IMPERSONATE_READY: 'impersonate_ready',
     CHAT_CHANGED: 'chat_id_changed',
 +    GENERATION_AFTER_COMMANDS: 'GENERATION_AFTER_COMMANDS',
     GENERATION_STARTED: 'generation_started',
     GENERATION_STOPPED: 'generation_stopped',
     GENERATION_ENDED: 'generation_ended',

 export const default_avatar = 'img/ai4.png';
 export const system_avatar = 'img/five.png';
 export const comment_avatar = 'img/quill.png';
 +export const default_user_avatar = 'img/user-default.png';
 export let CLIENT_VERSION = 'SillyTavern:UNKNOWN:Cohee#1207'; // For Horde header
 let optionsPopper = Popper.createPopper(document.getElementById('options_button'), document.getElementById('options'), {
     placement: 'top-start',

     addSafariPatch();
     await getClientVersion();
     await readSecretState();
     await initLocales();
     initDefaultSlashCommands();
     initTextGenModels();
 +    initOpenAI();
 +    initSystemPrompts();
 +    await initPresetManager();
     await getSystemMessages();
     sendSystemMessage(system_message_types.WELCOME);
     sendSystemMessage(system_message_types.WELCOME_PROMPT);

     initKeyboard();
     initDynamicStyles();
     initTags();
 -    initOpenai();
     initBookmarks();
     await getUserAvatars(true, user_avatar);
     await getCharacters();
     await getBackgrounds();
     await initTokenizers();
 -    await initPresetManager();
     initBackgrounds();
     initAuthorsNote();
     initPersonas();

         // Determine instruct mode preset
         autoSelectInstructPreset(online_status);
 +        const supportsTokenization = response.headers.get('x-supports-tokenization') === 'true';
 +        supportsTokenization ? sessionStorage.setItem(TOKENIZER_SUPPORTED_KEY, 'true') : sessionStorage.removeItem(TOKENIZER_SUPPORTED_KEY);
++
         // We didn't get a 200 status code, but the endpoint has an explanation. Which means it DID connect, but I digress.
         if (online_status === 'no_connection' && data.response) {
             toastr.error(data.response, 'API Error', { timeOut: 5000, preventDuplicates: true });

+}
 export async function reloadCurrentChat() {
 +    preserveNeutralChat();
     await clearChat();
     chat.length = 0;

+    }
     else {
         resetChatState();
 +        restoreNeutralChat();
         await getCharacters();
         await printMessages();
         await eventSource.emit(event_types.CHAT_CHANGED, getCurrentChatId());

  */
 export async function Generate(type, { automatic_trigger, force_name2, quiet_prompt, quietToLoud, skipWIAN, force_chid, signal, quietImage, quietName } = {}, dryRun = false) {
     console.log('Generate entered');
 -    await eventSource.emit(event_types.GENERATION_STARTED, type, { automatic_trigger, force_name2, quiet_prompt, quietToLoud, skipWIAN, force_chid, signal, quietImage }, dryRun);
     setGenerationProgress(0);
     generation_started = new Date();
 +    // Occurs every time, even if the generation is aborted due to slash commands execution
 +    await eventSource.emit(event_types.GENERATION_STARTED, type, { automatic_trigger, force_name2, quiet_prompt, quietToLoud, skipWIAN, force_chid, signal, quietImage }, dryRun);
++
     // Don't recreate abort controller if signal is passed
     if (!(abortController && signal)) {
         abortController = new AbortController();

@@ -3355,6 +3366,9 @@ export async function Generate(type, { automatic_trigger, force_name2, quiet_pro
3355	3366	}
3356	3367	}
3357	3368
	3369	+ // Occurs only if the generation is not aborted due to slash commands execution
	3370	+ await eventSource.emit(event_types.GENERATION_AFTER_COMMANDS, type, { automatic_trigger, force_name2, quiet_prompt, quietToLoud, skipWIAN, force_chid, signal, quietImage }, dryRun);
	3371	+
3358	3372	if (main_api == 'kobold' && kai_settings.streaming_kobold && !kai_flags.can_use_streaming) {
3359	3373	toastr.error('Streaming is enabled, but the version of Kobold used does not support token streaming.', undefined, { timeOut: 10000, preventDuplicates: true });
3360	3374	unblockGeneration(type);

         jailbreak,
     } = getCharacterCardFields();
     if (isInstructmain_api !== 'openai') {
 -        system = power_user.prefer_character_prompt && system ? system : baseChatReplace(power_user.instruct.system_prompt, name1, name2);
 +        if (power_user.sysprompt.enabled) {
 -        system = formatInstructModeSystemPrompt(substituteParams(system, name1, name2, power_user.instruct.system_prompt));
 +            system = power_user.prefer_character_prompt && system ? system : baseChatReplace(power_user.sysprompt.content, name1, name2);
 +            system = isInstruct ? formatInstructModeSystemPrompt(substituteParams(system, name1, name2, power_user.sysprompt.content)) : system;
 +        } else {
 +            // Nullify if it's not enabled
 +            system = '';
 +        }
+    }
     // Depth prompt (character-specific A/N)

         personality: personality,
         persona: power_user.persona_description_position == persona_description_positions.IN_PROMPT ? persona : '',
         scenario: scenario,
         system: isInstruct ? system : '',
         char: name2,
         user: name1,
         wiBefore: worldInfoBefore,

             this_max_context: this_max_context,
             padding: power_user.token_padding,
             main_api: main_api,
             instruction: isInstructmain_api !== 'openai' && power_user.sysprompt.enabled ? substituteParams(power_user.prefer_character_prompt && system ? system : power_user.instructsysprompt.system_promptcontent) : '',
             userPersona: (power_user.persona_description_position == persona_description_positions.IN_PROMPT ? (persona || '') : ''),
             tokenizer: getFriendlyTokenizerName(main_api).tokenizerName || '',
         };

@@ -4839,6 +4858,13 @@ export function getMaxContextSize(overrideResponseLength = null) {
4839	4858	console.log(`NovelAI subscription limit reached. Max context size is now ${this_max_context}`);
4840	4859	}
4841	4860	}
	4861	+ if (nai_settings.model_novel.includes('erato')) {
	4862	+ // subscriber limits coming soon
	4863	+ this_max_context = Math.min(max_context, 8192);
	4864	+
	4865	+ // Added special tokens and whatnot
	4866	+ this_max_context -= 1;
	4867	+ }
4842	4868
4843	4869	this_max_context = this_max_context - (overrideResponseLength \|\| amount_gen);
4844	4870	}

@@ -5466,7 +5492,7 @@ export function cleanUpMessage(getMessage, isImpersonate, isContinue, displayInc
5466	5492	}
5467	5493
5468	5494	if (!displayIncompleteSentences && power_user.trim_sentences) {
5469	5495	getMessage = trimToEndSentence(getMessage, power_user.include_newline);
5470	5496	}
5471	5497
5472	5498	if (power_user.trim_spaces) {

+}
 export function resetChatState() {
 +    // replaces deleted charcter name with system user since it will be displayed next.
 +    name2 = (this_chid === undefined && neutralCharacterName) ? neutralCharacterName : systemUserName;
     //unsets expected chid before reloading (related to getCharacters/printCharacters from using old arrays)
     this_chid = undefined;
 -    // replaces deleted charcter name with system user since it will be displayed next.
 -    name2 = systemUserName;
     // sets up system user to tell user about having deleted a character
     chat.splice(0, chat.length, ...SAFETY_CHAT);
     // resets chat metadata

+            }
             // Check whether `text` {string} includes all of the `fragments` {string[]}.
             function matchFragments(fragments, text) {
                 if (!text || !text.toLowerCase) {return false;
 -                    return false;
 +                return fragments.every(item => text.toLowerCase().includes(item));
 -                }
 -                return fragments.every(item => text.includes(item));
+            }
             const fragments = makeQueryFragments(searchQuery);
             // At least one chat message must match *all* the fragments.
             // Currently, this doesn't match if the fragment matches are distributed across several chat messages.
             return chatContent && Object.values(chatContent).some(message => matchFragments(fragments, message?.mes?.toLowerCase()));
         });
         console.debug(filteredData);

         return '';
+    }
 +    let connectionRequired = false;
++
 +    if (main_api !== apiConfig.selected) {
         $(`#main_api option[value='${apiConfig.selected || text}']`).prop('selected', true);
         $('#main_api').trigger('change');
 +        connectionRequired = true;
 +    }
     if (apiConfig.source && oai_settings.chat_completion_source !== apiConfig.source) {
         $(`#chat_completion_source option[value='${apiConfig.source}']`).prop('selected', true);
         $('#chat_completion_source').trigger('change');
 +        connectionRequired = true;
+    }
     if (apiConfig.type && textgen_settings.type !== apiConfig.type) {
         $(`#textgen_type option[value='${apiConfig.type}']`).prop('selected', true);
         $('#textgen_type').trigger('change');
 +        connectionRequired = true;
+    }
     if (connectionRequired && apiConfig.button) {
         $(apiConfig.button).trigger('click');
+    }

         is_group: !!selected_group,
         avatar_url: characters[this_chid]?.avatar,
         original_file: `${oldFileName}.jsonl`,
         renamed_file: `${newName.trim()}.jsonl`,
     };
     try {

@@ -8824,6 +8855,10 @@ export async function renameChat(oldFileName, newName) {
8824	8855	throw new Error('Server returned an error.');
8825	8856	}
8826	8857
	8858	+ if (data.sanitizedFileName) {
	8859	+ newName = data.sanitizedFileName;
	8860	+ }
	8861	+
8827	8862	if (selected_group) {
8828	8863	await renameGroupChat(selected_group, oldFileName, newName);
8829	8864	}

  * It also ensures to save the settings after all the operations.
  */
 async function removeCharacterFromUI() {
 +    preserveNeutralChat();
     await clearChat();
     $('#character_cross').clicktrigger('click');
 -    this_chid = undefined;
 +    resetChatState();
 -    characters.length = 0;
 -    name2 = systemUserName;
 -    chat.splice(0, chat.length, ...SAFETY_CHAT);
 -    chat_metadata = {};
     $(document.getElementById('rm_button_selected_ch')).children('h2').text('');
 -    this_chid = undefined;
 +    restoreNeutralChat();
     await getCharacters();
     await printMessages();
     saveSettingsDebounced();

public/scripts/PromptManager.js+39 -13 Viewed

 'use strict';
 import { callPopup, event_types, eventSource, is_send_press, main_api, substituteParams } from '../script.js';
 import { is_group_generating } from './group-chats.js';
 import { Message, TokenHandler } from './openai.js';
 import { power_user } from './power-user.js';
 import { debounce, waitUntilCondition, escapeHtml } from './utils.js';
 import { debounce_timeout } from './constants.js';
 import { renderTemplateAsync } from './templates.js';
 +import { Popup } from './popup.js';
 function debouncePromise(func, delay) {
     let timeoutId;

             document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_name').value = prompt.name;
             document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_role').value = 'system';
             document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_prompt').value = prompt.content ?? '';
             document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_injection_position').value = prompt.injection_position ?? 0;
             document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_injection_depth').value = prompt.injection_depth ?? DEFAULT_DEPTH;
             document.getElementById(this.configuration.prefix + 'prompt_manager_depth_block').style.visibility = prompt.injection_position === INJECTION_POSITION.ABSOLUTE ? 'visible' : 'hidden';
             document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_forbid_overrides').checked = prompt.forbid_overrides ?? false;
             document.getElementById(this.configuration.prefix + 'prompt_manager_forbid_overrides_block').style.visibility = this.overridablePrompts.includes(prompt.identifier) ? 'visible' : 'hidden';
 +            document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_prompt').disabled = prompt.marker ?? false;
             if (!this.systemPrompts.includes(promptId)) {
                 document.getElementById(this.configuration.prefix + 'prompt_manager_popup_entry_form_injection_position').removeAttribute('disabled');

         };
         // Delete selected prompt from list form and close edit form
         this.handleDeletePrompt = async (event) => {
 +            Popup.show.confirm('Are you sure you want to delete this prompt?', null).then((userChoice) => {
 +                if (!userChoice) return;
                 const promptID = document.getElementById(this.configuration.prefix + 'prompt_manager_footer_append_prompt').value;
                 const prompt = this.getPromptById(promptID);

                     this.render();
                     this.saveServiceSettings();
+                }
 +            });
         };
         // Create new prompt, then save it to settings and close form.

         // Import prompts for the selected character
         this.handleImport = () => {
             callPopupPopup.show.confirm('Existing prompts with the same ID will be overridden. Do you want to proceed?', 'confirm'null)
                 .then(userChoice => {
                     if (false === !userChoice) return;
                     const fileOpener = document.createElement('input');
                     fileOpener.type = 'file';

         // Restore default state of a characters prompt order
         this.handleCharacterReset = () => {
             callPopupPopup.show.confirm('This will reset the prompt order for this character. You will not lose any prompts.', 'confirm'null)
                 .then(userChoice => {
                     if (false === !userChoice) return;
                     this.removePromptOrderForCharacter(this.activeCharacter);
                     this.addPromptOrderForCharacter(this.activeCharacter, promptManagerDefaultPromptOrder);

      * @returns {boolean} True if the prompt can be edited, false otherwise.
      */
     isPromptEditAllowed(prompt) {
 -        return !prompt.marker;
 +        const forceEditPrompts = [
 +            'charDescription',
 +            'charPersonality',
 +            'scenario',
 +            'personaDescription',
 +            'worldInfoBefore',
 +            'worldInfoAfter',
 +        ];
 +        return forceEditPrompts.includes(prompt.identifier) || !prompt.marker;
+    }
     /**

      * @returns {boolean} True if the prompt can be deleted, false otherwise.
      */
     isPromptToggleAllowed(prompt) {
 -        const forceTogglePrompts = ['charDescription', 'charPersonality', 'scenario', 'personaDescription', 'worldInfoBefore', 'worldInfoAfter', 'main', 'chatHistory', 'dialogueExamples'];
 +        const forceTogglePrompts = [
 +            'charDescription',
 +            'charPersonality',
 +            'scenario',
 +            'personaDescription',
 +            'worldInfoBefore',
 +            'worldInfoAfter',
 +            'main',
 +            'chatHistory',
 +            'dialogueExamples',
 +        ];
         return prompt.marker && !forceTogglePrompts.includes(prompt.identifier) ? false : !this.configuration.toggleDisabled.includes(prompt.identifier);
+    }

         const forbidOverridesBlock = document.getElementById(this.configuration.prefix + 'prompt_manager_forbid_overrides_block');
         nameField.value = prompt.name ?? '';
         roleField.value = prompt.role ?? 'system';
         promptField.value = prompt.content ?? '';
 +        promptField.disabled = prompt.marker ?? false;
         injectionPositionField.value = prompt.injection_position ?? INJECTION_POSITION.RELATIVE;
         injectionDepthField.value = prompt.injection_depth ?? DEFAULT_DEPTH;
         injectionDepthBlock.style.visibility = prompt.injection_position === INJECTION_POSITION.ABSOLUTE ? 'visible' : 'hidden';

         nameField.value = '';
         roleField.selectedIndex = 0;
         promptField.value = '';
 +        promptField.disabled = false;
         injectionPositionField.selectedIndex = 0;
         injectionPositionField.removeAttribute('disabled');
         injectionDepthField.value = DEFAULT_DEPTH;

+            }
             const encodedName = escapeHtml(prompt.name);
 +            const isMarkerPrompt = prompt.marker && prompt.injection_position !== INJECTION_POSITION.ABSOLUTE;
             const isSystemPrompt = !prompt.marker && prompt.system_prompt && prompt.injection_position !== INJECTION_POSITION.ABSOLUTE && !prompt.forbid_overrides;
             const isImportantPrompt = !prompt.marker && prompt.system_prompt && prompt.injection_position !== INJECTION_POSITION.ABSOLUTE && prompt.forbid_overrides;
             const isUserPrompt = !prompt.marker && !prompt.system_prompt && prompt.injection_position !== INJECTION_POSITION.ABSOLUTE;
             const isInjectionPrompt = !prompt.marker && prompt.injection_position === INJECTION_POSITION.ABSOLUTE;
             const isOverriddenPrompt = Array.isArray(this.overriddenPrompts) && this.overriddenPrompts.includes(prompt.identifier);
             const importantClass = isImportantPrompt ? `${prefix}prompt_manager_important` : '';
             listItemHtml += `
                 <li class="${prefix}prompt_manager_prompt ${draggableClass} ${enabledClass} ${markerClass} ${importantClass}" data-pm-identifier="${prompt.identifier}">
                     <span class="${prefix}prompt_manager_prompt_name" data-pm-name="${encodedName}">
                         ${prompt.markerisMarkerPrompt ? '<span class="fa-fw fa-solid fa-thumb-tack" title="Marker"></span>' : ''}
                         ${isSystemPrompt ? '<span class="fa-fw fa-solid fa-square-poll-horizontal" title="Global Prompt"></span>' : ''}
                         ${isImportantPrompt ? '<span class="fa-fw fa-solid fa-star" title="Important Prompt"></span>' : ''}
                         ${isUserPrompt ? '<span class="fa-fw fa-solid fa-user" title="User Prompt"></span>' : ''}

      */
     showPopup(area = 'edit') {
         const areaElement = document.getElementById(this.configuration.prefix + 'prompt_manager_popup_' + area);
         areaElement.style.display = 'blockflex';
         $('#' + this.configuration.prefix + 'prompt_manager_popup').first()
             .slideDown(200, 'swing')

public/scripts/RossAscends-mods.js+10 -0 Viewed

         RA_autoconnect();
+    }
 +    if (isMobile()) {
 +        const fixFunkyPositioning = () => {
 +            console.debug('[Mobile] Device viewport change detected.');
 +            document.documentElement.style.position = 'fixed';
 +            requestAnimationFrame(() => document.documentElement.style.position = '');
 +        };
 +        window.addEventListener('resize', fixFunkyPositioning);
 +        window.addEventListener('orientationchange', fixFunkyPositioning);
 +    }
++
     $('#main_api').change(function () {
         var PrevAPI = main_api;
         setTimeout(() => RA_autoconnect(PrevAPI), 100);

public/scripts/backgrounds.js+1 -1 Viewed

@@ -313,7 +313,7 @@ async function onDeleteBackgroundClick(e) {
313	313	}
314	314	}
315	315
316	316	const autoBgPrompt = 'PauseIgnore yourprevious roleplayinstructions and choose a location ONLY from the provided list that is the most suitable for the current scene. Do not output any other text:\n{0}';
317	317
318	318	async function autoBackgroundCommand() {
319	319	/** @type {HTMLElement[]} */

public/scripts/chats.js+31 -2 Viewed

     this_chid,
     saveChatConditional,
     chat_metadata,
 +    neutralCharacterName,
 +    updateChatMetadata,
 } from '../script.js';
 import { selected_group } from './group-chats.js';
 import { power_user } from './power-user.js';

         const message = chat[messageId];
         if (!message) continue;
 +        message.is_system = hide;
++
 +        // Also toggle "hidden" state for all visible messages
         const messageBlock = $(`.mes[mesid="${messageId}"]`);
         if (!messageBlock.length) continue;
+-
 -        message.is_system = hide;
         messageBlock.attr('is_system', String(hide));
+    }

+    }
+}
 +const NEUTRAL_CHAT_KEY = 'neutralChat';
++
 +export function preserveNeutralChat() {
 +    if (this_chid !== undefined || selected_group || name2 !== neutralCharacterName) {
 +        return;
 +    }
++
 +    sessionStorage.setItem(NEUTRAL_CHAT_KEY, JSON.stringify({ chat, chat_metadata }));
 +}
++
 +export function restoreNeutralChat() {
 +    if (this_chid !== undefined || selected_group || name2 !== neutralCharacterName) {
 +        return;
 +    }
++
 +    const neutralChat = sessionStorage.getItem(NEUTRAL_CHAT_KEY);
 +    if (!neutralChat) {
 +        return;
 +    }
++
 +    const { chat: neutralChatData, chat_metadata: neutralChatMetadata } = JSON.parse(neutralChat);
 +    chat.splice(0, chat.length, ...neutralChatData);
 +    updateChatMetadata(neutralChatMetadata, true);
 +    sessionStorage.removeItem(NEUTRAL_CHAT_KEY);
 +}
++
 /**
  * Registers a file converter function.
  * @param {string} mimeType MIME type

public/scripts/extensions.js+0 -1 Viewed

     const characterId = context.characterId;
     if (saveMetadataTimeout) {
 -        console.debug('Clearing save metadata timeout');
         clearTimeout(saveMetadataTimeout);
+    }

public/scripts/extensions/caption/index.js+55 -22 Viewed

 import { ensureImageFormatSupported, getBase64Async, isTrueBoolean, saveBase64AsFile } from '../../utils.js';
 import { getContext, getApiUrl, doExtrasFetch, extension_settings, modules, renderExtensionTemplateAsync } from '../../extensions.js';
 import { appendMediaToMessage, callPopup, eventSource, event_types, getRequestHeaders, main_api, saveChatConditional, saveSettingsDebounced, substituteParamsExtended } from '../../../script.js';
 import { getMessageTimeStamp } from '../../RossAscends-mods.js';
 import { SECRET_KEYS, secret_state } from '../../secrets.js';
 import { getMultimodalCaption } from '../shared.js';

                 (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'openai' && (secret_state[SECRET_KEYS.OPENAI] || extension_settings.caption.allow_reverse_proxy)) ||
                 (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'openrouter' && secret_state[SECRET_KEYS.OPENROUTER]) ||
                 (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'zerooneai' && secret_state[SECRET_KEYS.ZEROONEAI]) ||
 +                (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'mistral' && (secret_state[SECRET_KEYS.MISTRALAI] || extension_settings.caption.allow_reverse_proxy)) ||
                 (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'google' && (secret_state[SECRET_KEYS.MAKERSUITE] || extension_settings.caption.allow_reverse_proxy)) ||
                 (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'anthropic' && (secret_state[SECRET_KEYS.CLAUDE] || extension_settings.caption.allow_reverse_proxy)) ||
                 (extension_settings.caption.source === 'multimodal' && extension_settings.caption.multimodal_api === 'ollama' && textgenerationwebui_settings.server_urls[textgen_types.OLLAMA]) ||

         $('#form_sheld').append(imgForm);
         $('#img_file').on('change', (e) => onSelectImage(e.originalEvent, '', false));
+    }
     async function switchMultimodalBlocks() {
 +        await addOpenRouterModels();
         const isMultimodal = extension_settings.caption.source === 'multimodal';
 -        $('#caption_ollama_pull').on('click', (e) => {
 -            const presetModel = extension_settings.caption.multimodal_model !== 'ollama_current' ? extension_settings.caption.multimodal_model : '';
 -            e.preventDefault();
 -            $('#ollama_download_model').trigger('click');
 -            $('#dialogue_popup_input').val(presetModel);
 -        });
         $('#caption_multimodal_block').toggle(isMultimodal);
         $('#caption_prompt_block').toggle(isMultimodal);
         $('#caption_multimodal_api').val(extension_settings.caption.multimodal_api);

             const types = type.split(',');
             $(this).toggle(types.includes(extension_settings.caption.multimodal_api));
         });
 -        $('#caption_multimodal_api').on('change', () => {
 -            const api = String($('#caption_multimodal_api').val());
 -            const model = String($(`#caption_multimodal_model option[data-type="${api}"]`).first().val());
 -            extension_settings.caption.multimodal_api = api;
 -            extension_settings.caption.multimodal_model = model;
 -            saveSettingsDebounced();
 -            switchMultimodalBlocks();
 -        });
 -        $('#caption_multimodal_model').on('change', () => {
 -            extension_settings.caption.multimodal_model = String($('#caption_multimodal_model').val());
 -            saveSettingsDebounced();
 -        });
+    }
     async function addSettings() {
         const html = await renderExtensionTemplateAsync('caption', 'settings', { TEMPLATE_DEFAULT, PROMPT_DEFAULT });
         $('#caption_container').append(html);
+    }
 +    async function addOpenRouterModels() {
 +        const dropdown = document.getElementById('caption_multimodal_model');
 +        if (!(dropdown instanceof HTMLSelectElement)) {
 +            return;
 +        }
 +        if (extension_settings.caption.source !== 'multimodal' || extension_settings.caption.multimodal_api !== 'openrouter') {
 +            return;
 +        }
 +        const options = Array.from(dropdown.options);
 +        const response = await fetch('/api/openrouter/models/multimodal', {
 +            method: 'POST',
 +            headers: getRequestHeaders(),
 +        });
 +        if (!response.ok) {
 +            return;
 +        }
 +        const modelIds = await response.json();
 +        if (Array.isArray(modelIds) && modelIds.length > 0) {
 +            modelIds.forEach((modelId) => {
 +                if (!modelId || typeof modelId !== 'string' || options.some(o => o.value === modelId)) {
 +                    return;
 +                }
 +                const option = document.createElement('option');
 +                option.value = modelId;
 +                option.textContent = modelId;
 +                option.dataset.type = 'openrouter';
 +                dropdown.add(option);
 +            });
 +        }
 +    }
     await addSettings();
     addPictureSendForm();
     addSendPictureButton();
     setImageIcon();
     migrateSettings();
     await switchMultimodalBlocks();
     $('#caption_refine_mode').prop('checked', !!(extension_settings.caption.refine_mode));
     $('#caption_allow_reverse_proxy').prop('checked', !!(extension_settings.caption.allow_reverse_proxy));

         extension_settings.caption.auto_mode = !!$('#caption_auto_mode').prop('checked');
         saveSettingsDebounced();
     });
 +    $('#caption_ollama_pull').on('click', (e) => {
 +        const presetModel = extension_settings.caption.multimodal_model !== 'ollama_current' ? extension_settings.caption.multimodal_model : '';
 +        e.preventDefault();
 +        $('#ollama_download_model').trigger('click');
 +        $('#dialogue_popup_input').val(presetModel);
 +    });
 +    $('#caption_multimodal_api').on('change', () => {
 +        const api = String($('#caption_multimodal_api').val());
 +        const model = String($(`#caption_multimodal_model option[data-type="${api}"]`).first().val());
 +        extension_settings.caption.multimodal_api = api;
 +        extension_settings.caption.multimodal_model = model;
 +        saveSettingsDebounced();
 +        switchMultimodalBlocks();
 +    });
 +    $('#caption_multimodal_model').on('change', () => {
 +        extension_settings.caption.multimodal_model = String($('#caption_multimodal_model').val());
 +        saveSettingsDebounced();
 +    });
     const onMessageEvent = async (index) => {
         if (!extension_settings.caption.auto_mode) {

+        }
     });
     SlashCommandParser.addCommandObject(SlashCommand.fromProps({ name: 'caption',
 +        name: 'caption',
         callback: captionCommandCallback,
         returns: 'caption',
         namedArgumentList: [

public/scripts/extensions/caption/settings.html+4 -1 Viewed

                         <option value="google">Google AI Studio</option>
                         <option value="koboldcpp">KoboldCpp</option>
                         <option value="llamacpp">llama.cpp</option>
 +                        <option value="mistral">MistralAI</option>
                         <option value="ollama">Ollama</option>
                         <option value="openai">OpenAI</option>
                         <option value="openrouter">OpenRouter</option>

                 <div class="flex1 flex-container flexFlowColumn flexNoGap">
                     <label for="caption_multimodal_model" data-i18n="Model">Model</label>
                     <select id="caption_multimodal_model" class="flex1 text_pole">
 +                        <option data-type="mistral" value="pixtral-latest">pixtral-latest</option>
 +                        <option data-type="mistral" value="pixtral-12b-2409">pixtral-12b-2409</option>
                         <option data-type="zerooneai" value="yi-vision">yi-vision</option>
                         <option data-type="openai" value="gpt-4-vision-preview">gpt-4-vision-preview</option>
                         <option data-type="openai" value="gpt-4-turbo">gpt-4-turbo</option>

                 <div data-type="ollama">
                     The model must be downloaded first! Do it with the <code>ollama pull</code> command or <a href="#" id="caption_ollama_pull">click here</a>.
                 </div>
                 <label data-type="openai,anthropic,google,mistral" class="checkbox_label flexBasis100p" for="caption_allow_reverse_proxy" title="Allow using reverse proxy if defined and valid.">
                     <input id="caption_allow_reverse_proxy" type="checkbox" class="checkbox">
                     <span data-i18n="Allow reverse proxy">Allow reverse proxy</span>
                 </label>

public/scripts/extensions/connection-manager/index.js+42 -7 Viewed

     selectedProfile: null,
 };
 const COMMON_COMMANDSCC_COMMANDS = [
     'api',
     'preset',
 +    // Do not fix; CC needs to set the API twice because it could be overridden by the preset
 +    'api',
     'api-url',
     'model',
 -];
+-
 -const CC_COMMANDS = [
 -    ...COMMON_COMMANDS,
     'proxy',
 ];
 const TC_COMMANDS = [
 -    ...COMMON_COMMANDS,
 +    'api',
 +    'preset',
 +    'api-url',
 +    'model',
 +    'sysprompt',
 +    'sysprompt-state',
     'instruct',
     'context',
     'instruct-state',

     'preset': 'Settings Preset',
     'model': 'Model',
     'proxy': 'Proxy Preset',
 +    'sysprompt-state': 'Use System Prompt',
 +    'sysprompt': 'System Prompt Name',
     'instruct-state': 'Instruct Mode',
     'instruct': 'Instruct Template',
     'context': 'Context Template',

+    }
     if (cleanUp) {
 +        for (const command of commands) {
 +            if (command.endsWith('-state') && profile[command] === 'false') {
 +                delete profile[command.replace('-state', '')];
 +            }
 +        }
         for (const command of opposingCommands) {
             if (commands.includes(command)) {
                 continue;

     noneOption.selected = !extension_settings.connectionManager.selectedProfile;
     profiles.appendChild(noneOption);
     for (const profile of extension_settings.connectionManager.profiles.sort((a, b) => a.name.localeCompare(b.name))) {
         const option = document.createElement('option');
         option.value = profile.id;
         option.textContent = profile.name;

         await eventSource.emit(event_types.CONNECTION_PROFILE_LOADED, NONE);
     });
 +    const renameButton = document.getElementById('rename_connection_profile');
 +    renameButton.addEventListener('click', async () => {
 +        const selectedProfile = extension_settings.connectionManager.selectedProfile;
 +        const profile = extension_settings.connectionManager.profiles.find(p => p.id === selectedProfile);
 +        if (!profile) {
 +            console.log('No profile selected');
 +            return;
 +        }
++
 +        const newName = await Popup.show.input('Enter a new name', null, profile.name, { rows: 2 });
 +        if (!newName) {
 +            return;
 +        }
++
 +        if (extension_settings.connectionManager.profiles.some(p => p.name === newName)) {
 +            toastr.error('A profile with the same name already exists.');
 +            return;
 +        }
++
 +        profile.name = newName;
 +        saveSettingsDebounced();
 +        renderConnectionProfiles(profiles);
 +        toastr.success('Connection profile renamed', '', { timeOut: 1500 });
 +    });
++
     /** @type {HTMLElement} */
     const viewDetails = document.getElementById('view_connection_profile');
     const detailsContent = document.getElementById('connection_profile_details_content');

public/scripts/extensions/connection-manager/settings.html+1 -0 Viewed

         <i id="view_connection_profile" class="menu_button fa-solid fa-info-circle" title="View connection profile details" data-i18n="[title]View connection profile details"></i>
         <i id="create_connection_profile" class="menu_button fa-solid fa-file-circle-plus" title="Create a new connection profile" data-i18n="[title]Create a new connection profile"></i>
         <i id="update_connection_profile" class="menu_button fa-solid fa-save" title="Update a connection profile" data-i18n="[title]Update a connection profile"></i>
 +        <i id="rename_connection_profile" class="menu_button fa-solid fa-pencil" title="Rename a connection profile" data-i18n="[title]Rename a connection profile"></i>
         <i id="reload_connection_profile" class="menu_button fa-solid fa-recycle" title="Reload a connection profile" data-i18n="[title]Reload a connection profile"></i>
         <i id="delete_connection_profile" class="menu_button fa-solid fa-trash-can" title="Delete a connection profile" data-i18n="[title]Delete a connection profile"></i>
     </div>

public/scripts/extensions/expressions/index.js+6 -1 Viewed

 const TALKINGCHECK_UPDATE_INTERVAL = 500;
 const DEFAULT_FALLBACK_EXPRESSION = 'joy';
 const FUNCTION_NAME = 'set_emotion';
 const DEFAULT_LLM_PROMPT = 'PauseIgnore yourprevious roleplayinstructions. Classify the emotion of the last message. Output just one word, e.g. "joy" or "anger". Choose only one of the following labels: {{labels}}';
 const DEFAULT_EXPRESSIONS = [
     'talkinghead',
     'admiration',

     });
     eventSource.on(event_types.MOVABLE_PANELS_RESET, updateVisualNovelModeDebounced);
     eventSource.on(event_types.GROUP_UPDATED, updateVisualNovelModeDebounced);
 +    eventSource.on(event_types.EXTRAS_CONNECTED, () => {
 +        if (extension_settings.expressions.talkinghead) {
 +            setTalkingHeadState(extension_settings.expressions.talkinghead);
 +        }
 +    });
     const localEnumProviders = {
         expressions: () => getCachedExpressions().map(expression => {

public/scripts/extensions/memory/index.js+1 -1 Viewed

     RAW_NON_BLOCKING: 2,
 };
 const defaultPrompt = '[PauseIgnore yourprevious roleplayinstructions. Summarize the most important facts and events in the story so far. If a summary already exists in your memory, use that as a base and expand with new facts. Limit the summary to {{words}} words or less. Your response should include nothing but the summary.]';
 const defaultTemplate = '[Summary: {{summary}}]';
 const defaultSettings = {

public/scripts/extensions/quick-reply/src/QuickReply.js+1 -0 Viewed

             executeOnAi: this.executeOnAi,
             executeOnChatChange: this.executeOnChatChange,
             executeOnGroupMemberDraft: this.executeOnGroupMemberDraft,
 +            executeOnNewChat: this.executeOnNewChat,
             automationId: this.automationId,
         };
+    }

public/scripts/extensions/quick-reply/src/SlashCommandHandler.js+4 -0 Viewed

             if (qr.executeOnUser) icons += enumIcons.user;
             if (qr.executeOnAi) icons += enumIcons.assistant;
             if (qr.executeOnChatChange) icons += '💬';
 +            if (qr.executeOnNewChat) icons += '🆕';
             if (qr.executeOnGroupMemberDraft) icons += enumIcons.group;
             return icons;
+        }

             new SlashCommandNamedArgument('user', 'auto execute on user message, e.g., user=true', [ARGUMENT_TYPE.BOOLEAN], false, false, 'false'),
             new SlashCommandNamedArgument('bot', 'auto execute on AI message, e.g., bot=true', [ARGUMENT_TYPE.BOOLEAN], false, false, 'false'),
             new SlashCommandNamedArgument('load', 'auto execute on chat load, e.g., load=true', [ARGUMENT_TYPE.BOOLEAN], false, false, 'false'),
 +            new SlashCommandNamedArgument('new', 'auto execute on new chat, e.g., new=true', [ARGUMENT_TYPE.BOOLEAN], false, false, 'false'),
             new SlashCommandNamedArgument('group', 'auto execute on group member selection, e.g., group=true', [ARGUMENT_TYPE.BOOLEAN], false, false, 'false'),
             new SlashCommandNamedArgument('title', 'title / tooltip to be shown on button, e.g., title="My Fancy Button"', [ARGUMENT_TYPE.STRING], false),
         ];

                     executeOnUser: isTrueBoolean(args.user),
                     executeOnAi: isTrueBoolean(args.bot),
                     executeOnChatChange: isTrueBoolean(args.load),
 +                    executeOnNewChat: isTrueBoolean(args.new),
                     executeOnGroupMemberDraft: isTrueBoolean(args.group),
                     automationId: args.automationId ?? '',
                 },

                     executeOnAi: args.bot === undefined ? undefined : isTrueBoolean(args.bot),
                     executeOnChatChange: args.load === undefined ? undefined : isTrueBoolean(args.load),
                     executeOnGroupMemberDraft: args.group === undefined ? undefined : isTrueBoolean(args.group),
 +                    executeOnNewChat: args.new === undefined ? undefined : isTrueBoolean(args.new),
                     automationId: args.automationId ?? '',
                 },
             );

public/scripts/extensions/shared.js+6 -2 Viewed

  */
 export async function getMultimodalCaption(base64Img, prompt) {
     const useReverseProxy =
         (['openai', 'anthropic', 'google', 'mistral'].includes(extension_settings.caption.multimodal_api))
         && extension_settings.caption.allow_reverse_proxy
         && oai_settings.reverse_proxy
         && isValidUrl(oai_settings.reverse_proxy);

     const isVllm = extension_settings.caption.multimodal_api === 'vllm';
     const base64Bytes = base64Img.length * 0.75;
     const compressionLimit = 2 * 1024 * 1024;
     if ((['google', 'openrouter', 'mistral'].includes(extension_settings.caption.multimodal_api) && base64Bytes > compressionLimit) || isOoba || isKoboldCpp) {
         const maxSide = 1024;
         base64Img = await createThumbnail(base64Img, maxSide, maxSide, 'image/jpeg');
+    }

@@ -139,6 +139,10 @@ function throwIfInvalidModel(useReverseProxy) {
139	139	throw new Error('Google AI Studio API key is not set.');
140	140	}
141	141
	142	+ if (extension_settings.caption.multi_modal_api === 'mistral' && !secret_state[SECRET_KEYS.MISTRALAI] && !useReverseProxy) {
	143	+ throw new Error('Mistral AI API key is not set.');
	144	+ }
	145	+
142	146	if (extension_settings.caption.multimodal_api === 'ollama' && !textgenerationwebui_settings.server_urls[textgen_types.OLLAMA]) {
143	147	throw new Error('Ollama server URL is not set.');
144	148	}

public/scripts/extensions/stable-diffusion/index.js+13 -11 Viewed

 const promptTemplates = {
     // Not really a prompt template, rather an outcome message template
     [generationMode.MESSAGE]: '[{{char}} sends a picture that contains: {{prompt}}].',
 -    /*OLD:     [generationMode.CHARACTER]: "Pause your roleplay and provide comma-delimited list of phrases and keywords which describe {{char}}'s physical appearance and clothing. Ignore {{char}}'s personality traits, and chat history when crafting this description. End your response once the comma-delimited list is complete. Do not roleplay when writing this description, and do not attempt to continue the story.", */
 +    [generationMode.CHARACTER]: 'In the next response I want you to provide only a detailed comma-delimited list of keywords and phrases which describe {{char}}. The list must include all of the following items in this order: name, species and race, gender, age, clothing, occupation, physical features and appearances. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase \'full body portrait,\'',
 -    [generationMode.CHARACTER]: '[In the next response I want you to provide only a detailed comma-delimited list of keywords and phrases which describe {{char}}. The list must include all of the following items in this order: name, species and race, gender, age, clothing, occupation, physical features and appearances. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase \'full body portrait,\']',
     //face-specific prompt
     [generationMode.FACE]: '[In the next response I want you to provide only a detailed comma-delimited list of keywords and phrases which describe {{char}}. The list must include all of the following items in this order: name, species and race, gender, age, facial features and expressions, occupation, hair and hair accessories (if any), what they are wearing on their upper body (if anything). Do not describe anything below their neck. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase \'close up facial portrait,\']',
     //prompt for only the last message
     [generationMode.USER]: '[PauseIgnore yourprevious roleplayinstructions and provide a detailed description of {{user}}\'s physical appearance from the perspective of {{char}} in the form of a comma-delimited list of keywords and phrases. The list must include all of the following items in this order: name, species and race, gender, age, clothing, occupation, physical features and appearances. Do not include descriptions of non-visual qualities such as personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase \'full body portrait,\'. Ignore the rest of the story when crafting this description. Do not roleplayreply as {{char}} when writing this description, and do not attempt to continue the story.]',
     [generationMode.SCENARIO]: '[PauseIgnore yourprevious roleplayinstructions and provide a detailed description for all of the following: a brief recap of recent events in the story, {{char}}\'s appearance, and {{char}}\'s surroundings. Do not roleplayreply as {{char}} while writing this description.]',
     [generationMode.NOW]: `[PauseIgnore yourprevious roleplayinstructions. Your next response must be formatted as a single comma-delimited list of concise keywords.  The list will describe of the visual details included in the last chat message.
     Only mention characters by using pronouns ('he','his','she','her','it','its') or neutral nouns ('male', 'the man', 'female', 'the woman').

     If character actions involve direct physical interaction with another character, mention specifically which body parts interacting and how.
     A correctly formatted example response would be:
     '(location),(character list by gender),(primary action), (relative character position) POV, (character 1's description and actions), (character 2's description and actions)']`,
     [generationMode.RAW_LAST]: '[PauseIgnore yourprevious roleplayinstructions and provide ONLY the last chat message string back to me verbatim. Do not write anything after the string. Do not roleplayreply atas all{{char}} inwhen yourwriting response.this Dodescription, and do not attempt to continue the roleplay story.]',
     [generationMode.BACKGROUND]: '[PauseIgnore yourprevious roleplayinstructions and provide a detailed description of {{char}}\'s surroundings in the form of a comma-delimited list of keywords and phrases. The list must include all of the following items in this order: location, time of day, weather, lighting, and any other relevant details. Do not include descriptions of characters and non-visual qualities such as names, personality, movements, scents, mental traits, or anything which could not be seen in a still photograph. Do not write in full sentences. Prefix your description with the phrase \'background,\'. Ignore the rest of the story when crafting this description. Do not roleplayreply as {{userchar}} when writing this description, and do not attempt to continue the story.]',
     [generationMode.FACE_MULTIMODAL]: 'Provide an exhaustive comma-separated list of tags describing the appearance of the character on this image in great detail. Start with "close-up portrait".',
     [generationMode.CHARACTER_MULTIMODAL]: 'Provide an exhaustive comma-separated list of tags describing the appearance of the character on this image in great detail. Start with "full body portrait".',
     [generationMode.USER_MULTIMODAL]: 'Provide an exhaustive comma-separated list of tags describing the appearance of the character on this image in great detail. Start with "full body portrait".',
     [generationMode.FREE_EXTENDED]: 'PauseIgnore yourprevious roleplayinstructions and provide an exhaustive comma-separated list of tags describing the appearance of "{0}" in great detail. Start with {{charPrefix}} (sic) if the subject is associated with {{char}}.',
 };
 const defaultPrefix = 'best quality, absurdres, aesthetic,';

         ],
         helpString: `
             <div>
                 Requests to generate an image and posts it to chat (unless <code>quiet=true</code> argument is specified).</code>.
 +            </div>
 +            <div>
 +                Supported arguments: <code>${Object.values(triggerWords).flat().join(', ')}</code>.
             </div>
             <div>
                 Anything else would trigger a "free mode" to make generate whatever you prompted. Example: <code>/imagine apple tree</code> would generate a picture of an apple tree. Returns a link to the generated image.

public/scripts/extensions/stable-diffusion/settings.html+1 -1 Viewed

                 </div>
             </div>
             <div class="flex-container marginTopBot5" data-sd-source="auto,vlad,extras,horde,drawthings,comfy">
                 <label class="flex1 checkbox_label">
                     <input id="sd_restore_faces" type="checkbox" />
                     <small data-i18n="Restore Faces">Restore Faces</small>

public/scripts/extensions/vectors/index.js+48 -85 Viewed

     summarize: false,
     summarize_sent: false,
     summary_source: 'main',
     summary_prompt: 'PauseIgnore yourprevious roleplayinstructions. Summarize the most important parts of the message. Limit yourself to 250 words or less. Your response should include nothing but the summary.',
     force_chunk_delimiter: '',
     // For chats

 async function getSavedHashes(collectionId) {
     const response = await fetch('/api/vector/list', {
         method: 'POST',
         headers: getRequestHeadersgetVectorHeaders(),
         body: JSON.stringify({
             collectionId: collectionId,
             source: settings.source,

     const headers = getRequestHeaders();
     switch (settings.source) {
         case 'extras':
 -            addExtrasHeaders(headers);
 -            break;
 -        case 'togetherai':
 -            addTogetherAiHeaders(headers);
 -            break;
 -        case 'openai':
 -            addOpenAiHeaders(headers);
 -            break;
 -        case 'cohere':
 -            addCohereHeaders(headers);
 -            break;
 -        case 'ollama':
 -            addOllamaHeaders(headers);
 -            break;
 -        case 'llamacpp':
 -            addLlamaCppHeaders(headers);
 -            break;
 -        case 'vllm':
 -            addVllmHeaders(headers);
 -            break;
 -        default:
 -            break;
 -    }
 -    return headers;
 -}
+-
 -/**
 - * Add headers for the Extras API source.
 - * @param {object} headers Headers object
 - */
 -function addExtrasHeaders(headers) {
 -    console.log(`Vector source is extras, populating API URL: ${extension_settings.apiUrl}`);
             Object.assign(headers, {
                 'X-Extras-Url': extension_settings.apiUrl,
                 'X-Extras-Key': extension_settings.apiKey,
             });
 -}
 +            break;
+-
 +        case 'togetherai':
 -/**
 - * Add headers for the TogetherAI API source.
 - * @param {object} headers Headers object
 - */
 -function addTogetherAiHeaders(headers) {
             Object.assign(headers, {
                 'X-Togetherai-Model': extension_settings.vectors.togetherai_model,
             });
 -}
 +            break;
+-
 +        case 'openai':
 -/**
 - * Add headers for the OpenAI API source.
 - * @param {object} headers Header object
 - */
 -function addOpenAiHeaders(headers) {
             Object.assign(headers, {
                 'X-OpenAI-Model': extension_settings.vectors.openai_model,
             });
 -}
 +            break;
+-
 +        case 'cohere':
 -/**
 - * Add headers for the Cohere API source.
 - * @param {object} headers Header object
 - */
 -function addCohereHeaders(headers) {
             Object.assign(headers, {
                 'X-Cohere-Model': extension_settings.vectors.cohere_model,
             });
 -}
 +            break;
+-
 +        case 'ollama':
 -/**
 - * Add headers for the Ollama API source.
 - * @param {object} headers Header object
 - */
 -function addOllamaHeaders(headers) {
             Object.assign(headers, {
                 'X-Ollama-Model': extension_settings.vectors.ollama_model,
                 'X-Ollama-URL': textgenerationwebui_settings.server_urls[textgen_types.OLLAMA],
                 'X-Ollama-Keep': !!extension_settings.vectors.ollama_keep,
             });
 -}
 +            break;
+-
 +        case 'llamacpp':
 -/**
 - * Add headers for the LlamaCpp API source.
 - * @param {object} headers Header object
 - */
 -function addLlamaCppHeaders(headers) {
             Object.assign(headers, {
                 'X-LlamaCpp-URL': textgenerationwebui_settings.server_urls[textgen_types.LLAMACPP],
             });
 -}
 +            break;
+-
 +        case 'vllm':
 -/**
 - * Add headers for the VLLM API source.
 - * @param {object} headers Header object
 - */
 -function addVllmHeaders(headers) {
             Object.assign(headers, {
                 'X-Vllm-URL': textgenerationwebui_settings.server_urls[textgen_types.VLLM],
                 'X-Vllm-Model': extension_settings.vectors.vllm_model,
             });
 +            break;
 +        default:
 +            break;
 +    }
 +    return headers;
+}
 /**

 async function deleteVectorItems(collectionId, hashes) {
     const response = await fetch('/api/vector/delete', {
         method: 'POST',
         headers: getRequestHeadersgetVectorHeaders(),
         body: JSON.stringify({
             collectionId: collectionId,
             hashes: hashes,

         const response = await fetch('/api/vector/purge', {
             method: 'POST',
             headers: getRequestHeadersgetVectorHeaders(),
             body: JSON.stringify({
                 collectionId: collectionId,
             }),

         const response = await fetch('/api/vector/purge', {
             method: 'POST',
             headers: getRequestHeadersgetVectorHeaders(),
             body: JSON.stringify({
                 collectionId: collectionId,
             }),

     try {
         const response = await fetch('/api/vector/purge-all', {
             method: 'POST',
             headers: getRequestHeadersgetVectorHeaders(),
         });
         if (!response.ok) {

+    }
+}
 +async function isModelScopesEnabled() {
 +    try {
 +        const response = await fetch('/api/vector/scopes-enabled', {
 +            method: 'GET',
 +            headers: getVectorHeaders(),
 +        });
++
 +        if (!response.ok) {
 +            return false;
 +        }
++
 +        const data = await response.json();
 +        return data?.enabled ?? false;
 +    } catch (error) {
 +        console.error('Vectors: Failed to check model scopes', error);
 +        return false;
 +    }
 +}
++
 function toggleSettings() {
     $('#vectors_files_settings').toggle(!!settings.enabled_files);
     $('#vectors_chats_settings').toggle(!!settings.enabled_chats);

+    }
     Object.assign(settings, extension_settings.vectors);
 +    const scopesEnabled = await isModelScopesEnabled();
     // Migrate from TensorFlow to Transformers
     settings.source = settings.source !== 'local' ? settings.source : 'transformers';

         saveSettingsDebounced();
     });
     $('#vectors_togetherai_model').val(settings.togetherai_model).on('change', () => {
         !scopesEnabled && $('#vectors_modelWarning').show();
         settings.togetherai_model = String($('#vectors_togetherai_model').val());
         Object.assign(extension_settings.vectors, settings);
         saveSettingsDebounced();
     });
     $('#vectors_openai_model').val(settings.openai_model).on('change', () => {
         !scopesEnabled && $('#vectors_modelWarning').show();
         settings.openai_model = String($('#vectors_openai_model').val());
         Object.assign(extension_settings.vectors, settings);
         saveSettingsDebounced();
     });
     $('#vectors_cohere_model').val(settings.cohere_model).on('change', () => {
         !scopesEnabled && $('#vectors_modelWarning').show();
         settings.cohere_model = String($('#vectors_cohere_model').val());
         Object.assign(extension_settings.vectors, settings);
         saveSettingsDebounced();
     });
     $('#vectors_ollama_model').val(settings.ollama_model).on('input', () => {
         !scopesEnabled && $('#vectors_modelWarning').show();
         settings.ollama_model = String($('#vectors_ollama_model').val());
         Object.assign(extension_settings.vectors, settings);
         saveSettingsDebounced();
     });
     $('#vectors_vllm_model').val(settings.vllm_model).on('input', () => {
         !scopesEnabled && $('#vectors_modelWarning').show();
         settings.vllm_model = String($('#vectors_vllm_model').val());
         Object.assign(extension_settings.vectors, settings);
         saveSettingsDebounced();

public/scripts/extensions/vectors/settings.html+3 -2 Viewed

             <small id="vectors_modelWarning">
                 <i class="fa-solid fa-exclamation-triangle"></i>
 -                <span data-i18n="Vectors Model Warning">
 +                <span>
 -                    It is recommended to purge vectors when changing the model mid-chat. Otherwise, it will lead to sub-par results.
 +                    Set <code>vectors.enableModelScopes</code> to true in config.yaml to switch between vectorization models without needing to purge existing vectors.
 +                    This option will soon be enabled by default.
                 </span>
             </small>

public/scripts/horde.js+78 -18 Viewed

 import {
     saveSettingsDebouncedamount_gen,
     callPopup,
 -    setGenerationProgress,
     getRequestHeaders,
     max_context,
     amount_gensaveSettingsDebounced,
 +    setGenerationProgress,
 } from '../script.js';
 import { SECRET_KEYS, writeSecret } from './secrets.js';
 import { delay } from './utils.js';

         headers: getRequestHeaders(),
         body: JSON.stringify({ force }),
     });
     const data =return await response.json();
 -    return data;
+}
 /**

         body: JSON.stringify({ force }),
     });
     const data = await response.json();
 +    console.log('getModels', data);
     return data;
+}
++
 /**
  * Gets the status of a Horde task.
  * @param {string} taskId Task ID

@@ -80,8 +81,7 @@ async function getTaskStatus(taskId) {
80	81	throw new Error(`Failed to get task status: ${response.statusText}`);
81	82	}
82	83
83	84	const data =return await response.json();
84		- return data;
85	85	}
86	86
87	87	/**

     for (const model of selectedModels) {
         for (const worker of workers) {
             if (model.cluster === worker.cluster && worker.models.includes(model.name)) {
                 // Skip workers that are not trusted if the option is enabled
                 if (horde_settings.trusted_workers_only && !worker.trusted) {
                     continue;

             console.log(generatedText);
             console.log(`Generated by Horde Worker: ${WorkerName} [${WorkerModel}]`);
             return { text: generatedText, workerName: `Generated by Horde worker: ${WorkerName} [${WorkerModel}]` };
 -        }
 +        } else if (!queue_position_first) {
 -        else if (!queue_position_first) {
             queue_position_first = statusCheckJson.queue_position;
             reportProgress && setGenerationProgress(0);
 -        }
 +        } else if (statusCheckJson.queue_position >= 0) {
 -        else if (statusCheckJson.queue_position >= 0) {
             let queue_position = statusCheckJson.queue_position;
             const progress = Math.round(100 - (queue_position / queue_position_first * 100));
             reportProgress && setGenerationProgress(progress);

     throw new Error('Horde timeout');
+}
++
 /**
  * Displays the available models in the Horde model selection dropdown.
  * @param {boolean} force Force refresh of the models
  */
 async function getHordeModels(force) {
 +    const sortByPerformance = (a, b) => b.performance - a.performance;
 +    const sortByWhitelisted = (a, b) => b.is_whitelisted - a.is_whitelisted;
 +    const sortByPopular = (a, b) => b.tags?.includes('popular') - a.tags?.includes('popular');
++
     $('#horde_model').empty();
     models = (await getModels(force)).sort((a, b) => b.performance - a.performance);{
 +        return sortByWhitelisted(a, b) || sortByPopular(a, b) || sortByPerformance(a, b);
 +    });
     for (const model of models) {
         const option = document.createElement('option');
         option.value = model.name;
 -        option.innerText = `${model.name} (ETA: ${model.eta}s, Speed: ${model.performance}, Queue: ${model.queued}, Workers: ${model.count})`;
 +        option.innerText = hordeModelTextString(model);
         option.selected = horde_settings.models.includes(model.name);
         $('#horde_model').append(option);
+    }

     toastr.info(`Kudos: ${data.kudos}`, data.username);
+}
 +function hordeModelTextString(model) {
 +    const q = hordeModelQueueStateString(model);
 +    return `${model.name} (${q})`;
 +}
++
 +function hordeModelQueueStateString(model) {
 +    return `ETA: ${model.eta}s, Speed: ${model.performance}, Queue: ${model.queued}, Workers: ${model.count}`;
 +}
++
 +function getHordeModelTemplate(option) {
 +    const model = models.find(x => x.name === option?.element?.value);
++
 +    if (!option.id || !model) {
 +        console.debug('No model found for option', option, option?.element?.value);
 +        console.debug('Models', models);
 +        return option.text;
 +    }
++
 +    const strip = html => {
 +        const tmp = document.createElement('DIV');
 +        tmp.innerHTML = html || '';
 +        return tmp.textContent || tmp.innerText || '';
 +    };
++
 +    // how much do we trust the metadata from the models repo? about this much
 +    const displayName = strip(model.display_name || model.name).replace(/.*\//g, '');
 +    const description = strip(model.description);
 +    const tags = model.tags ? model.tags.map(strip) : [];
 +    const url = strip(model.url);
 +    const style = strip(model.style);
++
 +    const workerInfo = hordeModelQueueStateString(model);
 +    const isPopular = model.tags?.includes('popular');
 +    const descriptionDiv = description ? `<div class="horde-model-description">${description}</div>` : '';
 +    const tagSpans = tags.length > 0 &&
 +        `${tags.map(tag => `<span class="tag tag_name">${tag}</span>`).join('')}</span>` || '';
++
 +    const modelDetailsLink = url && `<a href="${url}" target="_blank" rel="noopener noreferrer" class="model-details-link fa-solid fa-circle-question"> </a>`;
 +    const capitalize = s => s ? s[0].toUpperCase() + s.slice(1) : '';
 +    const innerContent = [
 +        `<strong>${displayName}</strong> ${modelDetailsLink}`,
 +        style ? `${capitalize(style)}` : '',
 +        tagSpans ? `<span class="tags tags_inline inline-flex margin-r2">${tagSpans}</span>` : '',
 +    ].filter(Boolean).join(' | ');
++
 +    return $((`
 +        <div class="flex-container flexFlowColumn">
 +            <div>
 +                ${isPopular ? '<span class="fa-fw fa-solid fa-star" title="Popular"></span>' : ''}
 +                ${innerContent}
 +            </div>
 +            ${descriptionDiv}
 +            <div><small>${workerInfo}</small></div>
 +        </div>
 +    `));
 +}
++
 jQuery(function () {
     $('#horde_model').on('mousedown change', async function (e) {
 +        console.log('Horde model change', e);
         horde_settings.models = $('#horde_model').val();
         console.log('Updated Horde models', horde_settings.models);

                 // Customize the pillbox text by shortening the full text
                 return data.id;
             },
 -            templateResult: function (data) {
 +            templateResult: getHordeModelTemplate,
 -                // Return the full text for the dropdown
 -                return data.text;
 -            },
         });
+    }
 });

public/scripts/instruct-mode.js+62 -54 Viewed

  */
 export let instruct_presets = [];
 +export const names_behavior_types = {
 +    NONE: 'none',
 +    FORCE: 'force',
 +    ALWAYS: 'always',
 +};
++
 const controls = [
     { id: 'instruct_enabled', property: 'enabled', isCheckbox: true },
     { id: 'instruct_wrap', property: 'wrap', isCheckbox: true },
 -    { id: 'instruct_system_prompt', property: 'system_prompt', isCheckbox: false },
     { id: 'instruct_system_sequence_prefix', property: 'system_sequence_prefix', isCheckbox: false },
     { id: 'instruct_system_sequence_suffix', property: 'system_sequence_suffix', isCheckbox: false },
     { id: 'instruct_input_sequence', property: 'input_sequence', isCheckbox: false },

     { id: 'instruct_last_system_sequence', property: 'last_system_sequence', isCheckbox: false },
     { id: 'instruct_user_alignment_message', property: 'user_alignment_message', isCheckbox: false },
     { id: 'instruct_stop_sequence', property: 'stop_sequence', isCheckbox: false },
 -    { id: 'instruct_names', property: 'names', isCheckbox: true },
 -    { id: 'instruct_macro', property: 'macro', isCheckbox: true },
 -    { id: 'instruct_names_force_groups', property: 'names_force_groups', isCheckbox: true },
     { id: 'instruct_first_output_sequence', property: 'first_output_sequence', isCheckbox: false },
     { id: 'instruct_last_output_sequence', property: 'last_output_sequence', isCheckbox: false },
     { id: 'instruct_first_input_sequence', property: 'first_input_sequence', isCheckbox: false },

     { id: 'instruct_activation_regex', property: 'activation_regex', isCheckbox: false },
     { id: 'instruct_bind_to_context', property: 'bind_to_context', isCheckbox: true },
     { id: 'instruct_skip_examples', property: 'skip_examples', isCheckbox: true },
 +    { id: 'instruct_names_behavior', property: 'names_behavior', isCheckbox: false },
     { id: 'instruct_system_same_as_user', property: 'system_same_as_user', isCheckbox: true, trigger: true },
 ];

         delete settings.separator_sequence;
+    }
 +    // names, names_force_groups => names_behavior
 +    if (settings.names !== undefined) {
 +        settings.names_behavior = settings.names
 +            ? names_behavior_types.ALWAYS
 +            : (settings.names_force_groups ? names_behavior_types.FORCE : names_behavior_types.NONE);
 +        delete settings.names;
 +        delete settings.names_force_groups;
 +    }
++
     const defaults = {
         input_suffix: '',
         system_sequence: '',

         names_force_groups: true,
         skip_examples: false,
         system_same_as_user: false,
 +        names_behavior: names_behavior_types.FORCE,
     };
     for (let key in defaults) {

         if (control.isCheckbox) {
             $element.prop('checked', power_user.instruct[control.property]);
 +        } else if ($element.is('select')) {
 +            const value = power_user.instruct[control.property];
 +            $element.val(value);
 +            $element.filter(`[value="${value}"]`).prop('checked', true);
         } else {
             $element.val(power_user.instruct[control.property]);
+        }

         option.selected = name === power_user.instruct.preset;
         $('#instruct_presets').append(option);
     });
+-
 -    highlightDefaultPreset();
 -}
+-
 -function highlightDefaultPreset() {
 -    $('#instruct_set_default').toggleClass('default', power_user.default_instruct === power_user.instruct.preset);
+}
 /**

         !quiet && toastr.info(`Context Template: "${preset}" ${isAuto ? 'auto-' : ''}selected`);
+    }
 -    // If instruct mode is disabled, enable it, except for default context template
 -    if (!power_user.instruct.enabled && preset !== power_user.default_context) {
 -        power_user.instruct.enabled = true;
 -        $('#instruct_enabled').prop('checked', true).trigger('change');
 -        !quiet && toastr.info('Instruct Mode enabled');
 -    }
+-
     saveSettingsDebounced();
+}

@@ -217,13 +221,6 @@ export function autoSelectInstructPreset(modelId) {
217	221	}
218	222	}
219	223	}
220		-
221		- if (power_user.instruct.bind_to_context && power_user.default_instruct && power_user.instruct.preset !== power_user.default_instruct) {
222		- if (instruct_presets.some(p => p.name === power_user.default_instruct)) {
223		- console.log(`Instruct mode: default preset "${power_user.default_instruct}" selected`);
224		- $('#instruct_presets').val(power_user.default_instruct).trigger('change');
225		- }
226		- }
227	224	}
228	225
229	226	return false;

  * @returns {string} Formatted instruct mode chat message.
  */
 export function formatInstructModeChat(name, mes, isUser, isNarrator, forceAvatar, name1, name2, forceOutputSequence) {
     let includeNames = isNarrator ? false : power_user.instruct.namesnames_behavior === names_behavior_types.ALWAYS;
     if (!isNarrator && power_user.instruct.names_force_groupsnames_behavior === names_behavior_types.FORCE && ((selected_group && name !== name1) || (forceAvatar && name !== name1))) {
         includeNames = true;
+    }

         return mesExamplesArray.map(x => x.replace(/<START>\n/i, blockHeading));
+    }
     const includeNames = power_user.instruct.namesnames_behavior === names_behavior_types.ALWAYS || (!!selected_group && power_user.instruct.names_force_groupsnames_behavior === names_behavior_types.FORCE);
     let inputPrefix = power_user.instruct.input_sequence || '';
     let outputPrefix = power_user.instruct.output_sequence || '';

         for (const example of blockExamples) {
             // If force group/persona names is set, we should override the include names for the user placeholder
             const includeThisName = includeNames || (power_user.instruct.names_force_groupsnames_behavior === names_behavior_types.FORCE && example.name == 'example_user');
             const prefix = example.name == 'example_user' ? inputPrefix : outputPrefix;
             const suffix = example.name == 'example_user' ? inputSuffix : outputSuffix;

  * @returns {string} Formatted instruct mode last prompt line.
  */
 export function formatInstructModePrompt(name, isImpersonate, promptBias, name1, name2, isQuiet, isQuietToLoud) {
     const includeNames = name && (power_user.instruct.namesnames_behavior === names_behavior_types.ALWAYS || (!!selected_group && power_user.instruct.names_force_groupsnames_behavior === names_behavior_types.FORCE)) && !(isQuiet && !isQuietToLoud);
     function getSequence() {
         // User impersonation prompt

+    }
     let sequence = getSequence() || '';
 +    let nameFiller = '';
++
 +    // A hack for Mistral's formatting that has a normal output sequence ending with a space
 +    if (
 +        includeNames &&
 +        power_user.instruct.last_output_sequence &&
 +        power_user.instruct.output_sequence &&
 +        sequence === power_user.instruct.last_output_sequence &&
 +        /\s$/.test(power_user.instruct.output_sequence) &&
 +        !/\s$/.test(power_user.instruct.last_output_sequence)
 +    ) {
 +        nameFiller = power_user.instruct.output_sequence.slice(-1);
 +    }
     if (power_user.instruct.macro) {
         sequence = substituteParams(sequence, name1, name2);

+    }
     const separator = power_user.instruct.wrap ? '\n' : '';
     let text = includeNames ? (separator + sequence + separator + nameFiller + `${name}:`) : (separator + sequence);
     // Quiet prompt already has a newline at the end
     if (isQuiet && separator) {

@@ -549,10 +559,6 @@ function selectMatchingContextTemplate(name) {
549	559	break;
550	560	}
551	561	}
552		- if (!foundMatch) {
553		- // If no match was found, select default context preset
554		- selectContextPreset(power_user.default_context, { isAuto: true });
555		- }
556	562	}
557	563
558	564	/**

     if (!input) {
         return '';
+    }
++
 +    const syspromptMacros = {
 +        'systemPrompt': (power_user.prefer_character_prompt && env.charPrompt ? env.charPrompt : power_user.sysprompt.content),
 +        'defaultSystemPrompt|instructSystem|instructSystemPrompt': power_user.sysprompt.content,
 +    };
++
     const instructMacros = {
 -        'systemPrompt': (power_user.prefer_character_prompt && env.charPrompt ? env.charPrompt : power_user.instruct.system_prompt),
 -        'instructSystem|instructSystemPrompt': power_user.instruct.system_prompt,
         'instructSystemPromptPrefix': power_user.instruct.system_sequence_prefix,
         'instructSystemPromptSuffix': power_user.instruct.system_sequence_suffix,
         'instructInput|instructUserPrefix': power_user.instruct.input_sequence,

         input = input.replace(regex, power_user.instruct.enabled ? value : '');
+    }
 +    for (const [placeholder, value] of Object.entries(syspromptMacros)) {
 +        const regex = new RegExp(`{{(${placeholder})}}`, 'gi');
 +        input = input.replace(regex, power_user.sysprompt.enabled ? value : '');
 +    }
++
     input = input.replace(/{{exampleSeparator}}/gi, power_user.context.example_separator);
     input = input.replace(/{{chatStart}}/gi, power_user.context.chat_start);

+}
 jQuery(() => {
 -    $('#instruct_set_default').on('click', function () {
 -        if (power_user.instruct.preset === power_user.default_instruct) {
 -            power_user.default_instruct = null;
 -            $(this).removeClass('default');
 -            toastr.info('Default instruct template cleared');
 -        } else {
 -            power_user.default_instruct = power_user.instruct.preset;
 -            $(this).addClass('default');
 -            toastr.info(`Default instruct template set to ${power_user.default_instruct}`);
 -        }
+-
 -        saveSettingsDebounced();
 -    });
+-
     $('#instruct_system_same_as_user').on('input', function () {
         const state = !!$(this).prop('checked');
         if (state) {

         // When instruct mode gets enabled, select context template matching selected instruct preset
         if (power_user.instruct.enabled) {
             selectMatchingContextTemplate(power_user.instruct.preset);
 -        } else {
 -            // When instruct mode gets disabled, select default context preset
 -            selectContextPreset(power_user.default_context);
+        }
     });

                 if (control.isCheckbox) {
                     $element.prop('checked', power_user.instruct[control.property]).trigger('input');
 +                } else if ($element.is('select')) {
 +                    const value = power_user.instruct[control.property];
 +                    $element.val(value);
 +                    $element.filter(`[value="${value}"]`).prop('checked', true).trigger('input');
                 } else {
                     $element.val(power_user.instruct[control.property]);
                     $element.trigger('input');

             // Select matching context template
             selectMatchingContextTemplate(name);
+        }
 +    });
 -        highlightDefaultPreset();
 +    if (!CSS.supports('field-sizing', 'content')) {
 +        $('#InstructSequencesColumn details').on('toggle', function () {
 +            if ($(this).prop('open')) {
 +                resetScrollHeight($(this).find('textarea'));
 +            }
         });
 +    }
 });

public/scripts/nai-settings.js+107 -30 Viewed

     novelai_setting_names,
     saveSettingsDebounced,
     setGenerationParamsFromPreset,
 -    substituteParams,
 } from '../script.js';
 -import { getCfgPrompt } from './cfg-scale.js';
 import { MAX_CONTEXT_DEFAULT, MAX_RESPONSE_DEFAULT, power_user } from './power-user.js';
 import { getTextTokens, tokenizers } from './tokenizers.js';
 import { getEventSourceStream } from './sse-stream.js';

 const default_presets = {
     'clio-v1': 'Talker-Chat-Clio',
     'kayra-v1': 'Carefree-Kayra',
 +    'llama-3-erato-v1': 'Erato-Dragonfruit',
 };
 export const nai_settings = {

     top_p: 0.75,
     top_a: 0.08,
     typical_p: 0.975,
 +    min_p: 0,
 +    math1_temp: 1,
 +    math1_quad: 0,
 +    math1_quad_entropy_scale: 0,
     min_length: 1,
     model_novel: 'clio-v1',
     preset_settings_novel: 'Talker-Chat-Clio',
     streaming_novel: false,
     preamble: default_preamble,
     prefix: '',
 -    cfg_uc: '',
     banned_tokens: '',
     order: default_order,
     logit_bias: [],

 : 'Opus',
 };
 +const samplers = {
 +    temperature: 0,
 +    top_k: 1,
 +    top_p: 2,
 +    tfs: 3,
 +    top_a: 4,
 +    typical_p: 5,
 +    // removed samplers were here
 +    mirostat: 8,
 +    math1: 9,
 +    min_p: 10,
 +};
++
 let novel_data = null;
 let badWordsCache = {};
 const BIAS_KEY = '#novel_api-settings';

     return maximum_output_length;
+}
 +export function convertNovelPreset(data) {
 +    if (!data || typeof data !== 'object' || data.presetVersion !== 3 || !data.parameters || typeof data.parameters !== 'object') {
 +        return data;
 +    }
++
 +    return {
 +        max_context: 8000,
 +        temperature: data.parameters.temperature,
 +        max_length: data.parameters.max_length,
 +        min_length: data.parameters.min_length,
 +        top_k: data.parameters.top_k,
 +        top_p: data.parameters.top_p,
 +        top_a: data.parameters.top_a,
 +        typical_p: data.parameters.typical_p,
 +        tail_free_sampling: data.parameters.tail_free_sampling,
 +        repetition_penalty: data.parameters.repetition_penalty,
 +        repetition_penalty_range: data.parameters.repetition_penalty_range,
 +        repetition_penalty_slope: data.parameters.repetition_penalty_slope,
 +        repetition_penalty_frequency: data.parameters.repetition_penalty_frequency,
 +        repetition_penalty_presence: data.parameters.repetition_penalty_presence,
 +        phrase_rep_pen: data.parameters.phrase_rep_pen,
 +        mirostat_lr: data.parameters.mirostat_lr,
 +        mirostat_tau: data.parameters.mirostat_tau,
 +        math1_temp: data.parameters.math1_temp,
 +        math1_quad: data.parameters.math1_quad,
 +        math1_quad_entropy_scale: data.parameters.math1_quad_entropy_scale,
 +        min_p: data.parameters.min_p,
 +        order: Array.isArray(data.parameters.order) ? data.parameters.order.filter(s => s.enabled && Object.keys(samplers).includes(s.id)).map(s => samplers[s.id]) : default_order,
 +    };
 +}
++
 export function getNovelTier() {
     return nai_tiers[novel_data?.tier] ?? 'no_connection';
+}

     nai_settings.top_a = preset.top_a;
     nai_settings.typical_p = preset.typical_p;
     nai_settings.min_length = preset.min_length;
 -    nai_settings.cfg_scale = preset.cfg_scale;
     nai_settings.phrase_rep_pen = preset.phrase_rep_pen;
     nai_settings.mirostat_lr = preset.mirostat_lr;
     nai_settings.mirostat_tau = preset.mirostat_tau;
     nai_settings.prefix = preset.prefix;
 -    nai_settings.cfg_uc = preset.cfg_uc || '';
     nai_settings.banned_tokens = preset.banned_tokens || '';
     nai_settings.order = preset.order || default_order;
     nai_settings.logit_bias = preset.logit_bias || [];
     nai_settings.preamble = preset.preamble || default_preamble;
 +    nai_settings.min_p = preset.min_p || 0;
 +    nai_settings.math1_temp = preset.math1_temp || 1;
 +    nai_settings.math1_quad = preset.math1_quad || 0;
 +    nai_settings.math1_quad_entropy_scale = preset.math1_quad_entropy_scale || 0;
     loadNovelSettingsUi(nai_settings);
+}

     nai_settings.typical_p = settings.typical_p;
     nai_settings.min_length = settings.min_length;
     nai_settings.phrase_rep_pen = settings.phrase_rep_pen;
 -    nai_settings.cfg_scale = settings.cfg_scale;
     nai_settings.mirostat_lr = settings.mirostat_lr;
     nai_settings.mirostat_tau = settings.mirostat_tau;
     nai_settings.streaming_novel = !!settings.streaming_novel;
     nai_settings.preamble = settings.preamble || default_preamble;
     nai_settings.prefix = settings.prefix;
 -    nai_settings.cfg_uc = settings.cfg_uc || '';
     nai_settings.banned_tokens = settings.banned_tokens || '';
     nai_settings.order = settings.order || default_order;
     nai_settings.logit_bias = settings.logit_bias || [];
 +    nai_settings.min_p = settings.min_p || 0;
 +    nai_settings.math1_temp = settings.math1_temp || 1;
 +    nai_settings.math1_quad = settings.math1_quad || 0;
 +    nai_settings.math1_quad_entropy_scale = settings.math1_quad_entropy_scale || 0;
     loadNovelSettingsUi(nai_settings);
+}

     $('#top_a_counter_novel').val(Number(ui_settings.top_a).toFixed(3));
     $('#typical_p_novel').val(ui_settings.typical_p);
     $('#typical_p_counter_novel').val(Number(ui_settings.typical_p).toFixed(3));
 -    $('#cfg_scale_novel').val(ui_settings.cfg_scale);
 -    $('#cfg_scale_counter_novel').val(Number(ui_settings.cfg_scale).toFixed(2));
     $('#phrase_rep_pen_novel').val(ui_settings.phrase_rep_pen || 'off');
     $('#mirostat_lr_novel').val(ui_settings.mirostat_lr);
     $('#mirostat_lr_counter_novel').val(Number(ui_settings.mirostat_lr).toFixed(2));

     $('#min_length_counter_novel').val(Number(ui_settings.min_length).toFixed(0));
     $('#nai_preamble_textarea').val(ui_settings.preamble);
     $('#nai_prefix').val(ui_settings.prefix || 'vanilla');
 -    $('#nai_cfg_uc').val(ui_settings.cfg_uc || '');
     $('#nai_banned_tokens').val(ui_settings.banned_tokens || '');
 +    $('#min_p_novel').val(ui_settings.min_p);
 +    $('#min_p_counter_novel').val(Number(ui_settings.min_p).toFixed(3));
 +    $('#math1_temp_novel').val(ui_settings.math1_temp);
 +    $('#math1_temp_counter_novel').val(Number(ui_settings.math1_temp).toFixed(2));
 +    $('#math1_quad_novel').val(ui_settings.math1_quad);
 +    $('#math1_quad_counter_novel').val(Number(ui_settings.math1_quad).toFixed(2));
 +    $('#math1_quad_entropy_scale_novel').val(ui_settings.math1_quad_entropy_scale);
 +    $('#math1_quad_entropy_scale_counter_novel').val(Number(ui_settings.math1_quad_entropy_scale).toFixed(2));
     $('#streaming_novel').prop('checked', ui_settings.streaming_novel);
     sortItemsByOrder(ui_settings.order);

         setValue: (val) => { nai_settings.mirostat_lr = Number(val).toFixed(2); },
     },
+    {
 -        sliderId: '#cfg_scale_novel',
 -        counterId: '#cfg_scale_counter_novel',
 -        format: (val) => `${val}`,
 -        setValue: (val) => { nai_settings.cfg_scale = Number(val).toFixed(2); },
 -    },
 -    {
         sliderId: '#min_length_novel',
         counterId: '#min_length_counter_novel',
         format: (val) => `${val}`,
         setValue: (val) => { nai_settings.min_length = Number(val).toFixed(0); },
     },
+    {
 -        sliderId: '#nai_cfg_uc',
 -        counterId: '#nai_cfg_uc_counter',
 -        format: (val) => val,
 -        setValue: (val) => { nai_settings.cfg_uc = val; },
 -    },
 -    {
         sliderId: '#nai_banned_tokens',
         counterId: '#nai_banned_tokens_counter',
         format: (val) => val,
         setValue: (val) => { nai_settings.banned_tokens = val; },
     },
 +    {
 +        sliderId: '#min_p_novel',
 +        counterId: '#min_p_counter_novel',
 +        format: (val) => Number(val).toFixed(3),
 +        setValue: (val) => { nai_settings.min_p = Number(val); },
 +    },
 +    {
 +        sliderId: '#math1_temp_novel',
 +        counterId: '#math1_temp_counter_novel',
 +        format: (val) => Number(val).toFixed(2),
 +        setValue: (val) => { nai_settings.math1_temp = Number(val); },
 +    },
 +    {
 +        sliderId: '#math1_quad_novel',
 +        counterId: '#math1_quad_counter_novel',
 +        format: (val) => Number(val).toFixed(2),
 +        setValue: (val) => { nai_settings.math1_quad = Number(val); },
 +    },
 +    {
 +        sliderId: '#math1_quad_entropy_scale_novel',
 +        counterId: '#math1_quad_entropy_scale_counter_novel',
 +        format: (val) => Number(val).toFixed(2),
 +        setValue: (val) => { nai_settings.math1_quad_entropy_scale = Number(val); },
 +    },
 ];
 function getBadWordIds(banned_tokens, tokenizerType) {

     return result.filter(onlyUnique);
+}
 export function getNovelGenerationData(finalPrompt, settings, maxLength, isImpersonate, isContinue, cfgValues_cfgValues, type) {
     console.debug('NovelAI generation data for', type);
 -    if (cfgValues && cfgValues.guidanceScale && cfgValues.guidanceScale?.value !== 1) {
 -        cfgValues.negativePrompt = (getCfgPrompt(cfgValues.guidanceScale, true))?.value;
 -    }
     const tokenizerType = getTokenizerTypeForModel(nai_settings.model_novel);
     const stopSequences = (tokenizerType !== tokenizers.NONE)

         console.log(finalPrompt);
+    }
     const adjustedMaxLengthisKayra = nai_settings.model_novel.includes('kayra') ? getKayraMaxResponseTokens() : maximum_output_length;
 +    const isErato = nai_settings.model_novel.includes('erato');
++
 +    if (isErato) {
 +        finalPrompt = '<|startoftext|>' + finalPrompt;
 +    }
++
 +    const adjustedMaxLength = (isKayra || isErato) ? getKayraMaxResponseTokens() : maximum_output_length;
     return {
         'input': finalPrompt,

         'top_a': Number(nai_settings.top_a),
         'top_p': Number(nai_settings.top_p),
         'top_k': Number(nai_settings.top_k),
 +        'min_p': Number(nai_settings.min_p),
 +        'math1_temp': Number(nai_settings.math1_temp),
 +        'math1_quad': Number(nai_settings.math1_quad),
 +        'math1_quad_entropy_scale': Number(nai_settings.math1_quad_entropy_scale),
         'typical_p': Number(nai_settings.typical_p),
         'mirostat_lr': Number(nai_settings.mirostat_lr),
         'mirostat_tau': Number(nai_settings.mirostat_tau),
 -        'cfg_scale': cfgValues?.guidanceScale?.value ?? Number(nai_settings.cfg_scale),
 -        'cfg_uc': cfgValues?.negativePrompt ?? substituteParams(nai_settings.cfg_uc) ?? '',
         'phrase_rep_pen': nai_settings.phrase_rep_pen,
         'stop_sequences': stopSequences,
         'bad_words_ids': badWordIds,

     let useInstruct = false;
     const clio = nai_settings.model_novel.includes('clio');
     const kayra = nai_settings.model_novel.includes('kayra');
 -    const isNewModel = clio || kayra;
 +    const erato = nai_settings.model_novel.includes('erato');
 +    const isNewModel = clio || kayra || erato;
     if (isNewModel) {
         // NovelAI claims they scan backwards 1000 characters (not tokens!) to look for instruct brackets. That's really short.

@@ -511,6 +585,9 @@ function getTokenizerTypeForModel(model) {
511	585	if (model.includes('kayra')) {
512	586	return tokenizers.NERD2;
513	587	}
	588	+ if (model.includes('erato')) {
	589	+ return tokenizers.LLAMA3;
	590	+ }
514	591	return tokenizers.NONE;
515	592	}
516	593

public/scripts/openai.js+40 -13 Viewed

             case character_names_behavior.NONE:
                 break;
             case character_names_behavior.DEFAULT:
                 if ((selected_group && chat[j].name !== name1) || (chat[j].force_avatar && chat[j].name !== name1 && chat[j].extra?.type !== system_message_types.NARRATOR)) {
                     content = `${chat[j].name}: ${content}`;
+                }
                 break;

+        }
         const prompt = prompts.get(source);
++
 +        if (prompt.injection_position === INJECTION_POSITION.ABSOLUTE) {
 +            promptManager.log(`Skipping prompt ${source} because it is an absolute prompt`);
 +            return;
 +        }
++
         const index = target ? prompts.index(target) : prompts.index(source);
         const collection = new MessageCollection(source);
         collection.add(Message.fromPrompt(prompt));

             acc.push(prompt.identifier);
             return acc;
         }, []);
     const userAbsolutePromptsabsolutePrompts = prompts.collection
         .filter((prompt) => false === prompt.system_prompt && prompt.injection_position === INJECTION_POSITION.ABSOLUTE)
         .reduce((acc, prompt) => {
             acc.push(prompt);
             return acc;

+    }
     // Add in-chat injections
     messages = populationInjectionPrompts(userAbsolutePromptsabsolutePrompts, messages);
     // Decide whether dialogue examples should always be added
     if (power_user.pin_examples) {

     // Merge system prompts with prompt manager prompts
     systemPrompts.forEach(prompt => {
 +        const collectionPrompt = prompts.get(prompt.identifier);
++
 +        // Apply system prompt role/depth overrides if they set in the prompt manager
 +        if (collectionPrompt) {
 +            // In-Chat / Relative
 +            prompt.injection_position = collectionPrompt.injection_position ?? prompt.injection_position;
 +            // Depth for In-Chat
 +            prompt.injection_depth = collectionPrompt.injection_depth ?? prompt.injection_depth;
 +            // Role (system, user, assistant)
 +            prompt.role = collectionPrompt.role ?? prompt.role;
 +        }
++
         const newPrompt = promptManager.preparePrompt(prompt);
         const markerIndex = prompts.index(prompt.identifier);

      * @returns {Promise<string>} Compressed image as a Data URL.
      */
     async compressImage(image) {
         if ([chat_completion_sources.OPENROUTER, chat_completion_sources.MAKERSUITE, chat_completion_sources.MISTRALAI].includes(oai_settings.chat_completion_source)) {
             const sizeThreshold = 2 * 1024 * 1024;
             const dataSize = image.length * 0.75;
             const maxSide = 1024;

@@ -2747,7 +2765,7 @@ export class ChatCompletion {
2747	2765	const message = { role: item.role, content: item.content, ...(item.name ? { name: item.name } : {}) };
2748	2766	chat.push(message);
2749	2767	} else {
2750	2768	consolethis.warnlog('Invalid`Skipping invalid or empty message in collection',: ${JSON.stringify(item)}`);
2751	2769	}
2752	2770	}
2753	2771	return chat;

         const responseData = await response.json();
 -        if (!('error' in responseData)) {
 -            setOnlineStatus('Valid');
 -        }
         if ('data' in responseData && Array.isArray(responseData.data)) {
             saveModelList(responseData.data);
+        }
 +        if (!('error' in responseData)) {
 +            setOnlineStatus('Valid');
 +        }
     } catch (error) {
         console.error(error);

             $('#openai_max_context').attr('max', max_2mil);
         } else if (value.includes('gemini-1.5-pro')) {
             $('#openai_max_context').attr('max', max_2mil);
 +        } else if (value.match('gemini-1.5-flash-002')) {
 +            $('#openai_max_context').attr('max', max_2mil);
         } else if (value.includes('gemini-1.5-flash')) {
             $('#openai_max_context').attr('max', max_1mil);
         } else if (value.includes('gemini-1.0-pro-vision') || value === 'gemini-pro-vision') {

             $('#openai_max_context').attr('max', max_128k);
         } else if (oai_settings.mistralai_model.includes('mixtral-8x22b')) {
             $('#openai_max_context').attr('max', max_64k);
 +        } else if (oai_settings.mistralai_model.includes('pixtral')) {
 +            $('#openai_max_context').attr('max', max_128k);
         } else {
             $('#openai_max_context').attr('max', max_32k);
+        }

         'gemini-1.5-flash',
         'gemini-1.5-flash-latest',
         'gemini-1.5-flash-001',
 +        'gemini-1.5-flash-002',
         'gemini-1.5-flash-exp-0827',
         'gemini-1.5-flash-8b-exp-0827',
 +        'gemini-1.5-flash-8b-exp-0924',
         'gemini-1.0-pro-vision-latest',
         'gemini-1.5-pro',
         'gemini-1.5-pro-latest',
         'gemini-1.5-pro-001',
 +        'gemini-1.5-pro-002',
         'gemini-1.5-pro-exp-0801',
         'gemini-1.5-pro-exp-0827',
         'gemini-pro-vision',

         'gpt-4o-mini',
         'chatgpt-4o-latest',
         'yi-vision',
 +        'pixtral-latest',
 +        'pixtral-12b-2409',
     ];
     switch (oai_settings.chat_completion_source) {

             return true;
         case chat_completion_sources.ZEROONEAI:
             return visionSupportedModels.some(model => oai_settings.zerooneai_model.includes(model));
 +        case chat_completion_sources.MISTRALAI:
 +            return visionSupportedModels.some(model => oai_settings.mistralai_model.includes(model));
         default:
             return false;
+    }

     return foundName;
+}
 export function initOpenaiinitOpenAI() {
     SlashCommandParser.addCommandObject(SlashCommand.fromProps({
         name: 'proxy',
         callback: runProxyCallback,

         ],
         helpString: 'Sets a proxy preset by name.',
     }));
 -}
 -$(document).ready(async function () {
     $('#test_api_button').on('click', testApiConnection);
     $('#scale-alt').on('change', function () {

     $('#openai_proxy_password_show').on('click', onProxyPasswordShowClick);
     $('#customize_additional_parameters').on('click', onCustomizeParametersClick);
     $('#openai_proxy_preset').on('change', onProxyPresetChange);
 });

public/scripts/personas.js+3 -3 Viewed

     characters,
     chat,
     chat_metadata,
     default_avatardefault_user_avatar,
     eventSource,
     event_types,
     getRequestHeaders,

     // Date + name (only ASCII) to make it unique
     const avatarId = `${Date.now()}-${personaName.replace(/[^a-zA-Z0-9]/g, '')}.png`;
     initPersona(avatarId, personaName, '');
     await uploadUserAvatar(default_avatardefault_user_avatar, avatarId);
+}
 /**

@@ -944,7 +944,7 @@ async function onPersonasRestoreInput(e) {
944	944	// If the avatar is missing, upload it
945	945	if (!avatarsList.includes(key)) {
946	946	warnings.push(`Persona image "${key}" (${value}) is missing, uploading default avatar`);
947	947	await uploadUserAvatar(default_avatardefault_user_avatar, key);
948	948	}
949	949	}
950	950

public/scripts/power-user.js+10 -42 Viewed

 import {
     instruct_presets,
     loadInstructMode,
 +    names_behavior_types,
     selectInstructPreset,
 } from './instruct-mode.js';

 import { SlashCommandEnumValue, enumTypes } from './slash-commands/SlashCommandEnumValue.js';
 import { commonEnumProviders, enumIcons } from './slash-commands/SlashCommandCommonEnumsProvider.js';
 import { POPUP_TYPE, callGenericPopup } from './popup.js';
 +import { loadSystemPrompts } from './sysprompt.js';
 export {
     loadPowerUserSettings,

     pin_examples: false,
     strip_examples: false,
     trim_sentences: false,
 -    include_newline: false,
     always_force_name2: false,
     user_prompt_bias: '',
     show_user_prompt_bias: true,

     disable_group_trimming: false,
     single_line: false,
 -    default_instruct: '',
     instruct: {
         enabled: false,
         preset: 'Alpaca',
 -        system_prompt: 'Below is an instruction that describes a task. Write a response that appropriately completes the request.\n\nWrite {{char}}\'s next reply in a fictional roleplay chat between {{user}} and {{char}}.\n',
         input_sequence: '### Instruction:',
         input_suffix: '',
         output_sequence: '### Response:',

         stop_sequence: '',
         wrap: true,
         macro: true,
         namesnames_behavior: falsenames_behavior_types.FORCE,
 -        names_force_groups: true,
         activation_regex: '',
         bind_to_context: false,
         user_alignment_message: '',

         separator_sequence: '',
     },
 -    default_context: 'Default',
     context: {
         preset: 'Default',
         story_string: defaultStoryString,

         names_as_stop_strings: true,
     },
 +    sysprompt: {
 +        enabled: true,
 +        name: 'Neutral - Chat',
 +        content: 'Write {{char}}\'s next reply in a fictional chat between {{char}} and {{user}}.',
 +    },
++
     personas: {},
     default_persona: null,
     persona_descriptions: {},

     // Existing power user settings
     { id: 'always-force-name2-checkbox', property: 'always_force_name2', isCheckbox: true, isGlobalSetting: true, defaultValue: true },
     { id: 'trim_sentences_checkbox', property: 'trim_sentences', isCheckbox: true, isGlobalSetting: true, defaultValue: false },
 -    { id: 'include_newline_checkbox', property: 'include_newline', isCheckbox: true, isGlobalSetting: true, defaultValue: false },
     { id: 'single_line', property: 'single_line', isCheckbox: true, isGlobalSetting: true, defaultValue: false },
 ];

     $('#collapse-newlines-checkbox').prop('checked', power_user.collapse_newlines);
     $('#always-force-name2-checkbox').prop('checked', power_user.always_force_name2);
     $('#trim_sentences_checkbox').prop('checked', power_user.trim_sentences);
 -    $('#include_newline_checkbox').prop('checked', power_user.include_newline);
     $('#render_formulas').prop('checked', power_user.render_formulas);
     $('#disable_group_trimming').prop('checked', power_user.disable_group_trimming);
     $('#markdown_escape_strings').val(power_user.markdown_escape_strings);

     reloadMarkdownProcessor(power_user.render_formulas);
     await loadInstructMode(data);
     await loadContextSettings();
 +    await loadSystemPrompts(data);
     loadMaxContextUnlocked();
     switchWaifuMode();
     switchSpoilerMode();

+            }
+        }
 -        highlightDefaultContext();
 -        saveSettingsDebounced();
 -    });
+-
 -    $('#context_set_default').on('click', function () {
 -        if (power_user.context.preset !== power_user.default_context) {
 -            power_user.default_context = power_user.context.preset;
 -            $(this).addClass('default');
 -            toastr.info(`Default context template set to ${power_user.default_context}`);
+-
 -            highlightDefaultContext();
+-
         saveSettingsDebounced();
 -        }
     });
+-
 -    highlightDefaultContext();
 -}
+-
 -function highlightDefaultContext() {
 -    $('#context_set_default').toggleClass('default', power_user.default_context === power_user.context.preset);
 -    $('#context_set_default').toggleClass('disabled', power_user.default_context === power_user.context.preset);
 -    $('#context_delete_preset').toggleClass('disabled', power_user.default_context === power_user.context.preset);
+}
 /**

     // if trim sentences is unchecked, include newline must be unchecked
     $('#trim_sentences_checkbox').change(function () {
         power_user.trim_sentences = !!$(this).prop('checked');
 -        if (!$(this).prop('checked')) {
 -            $('#include_newline_checkbox').prop('checked', false);
 -            power_user.include_newline = false;
 -        }
 -        saveSettingsDebounced();
 -    });
+-
 -    $('#include_newline_checkbox').change(function () {
 -        power_user.include_newline = !!$(this).prop('checked');
 -        if ($(this).prop('checked')) {
 -            $('#trim_sentences_checkbox').prop('checked', true);
 -            power_user.trim_sentences = true;
 -        }
         saveSettingsDebounced();
     });

public/scripts/preset-manager.js+264 -9 Viewed

 import { groups, selected_group } from './group-chats.js';
 import { instruct_presets } from './instruct-mode.js';
 import { kai_settings } from './kai-settings.js';
 import { PopupconvertNovelPreset } from './popupnai-settings.js';
 +import { Popup, POPUP_RESULT, POPUP_TYPE } from './popup.js';
 import { context_presets, getContextSettings, power_user } from './power-user.js';
 import { SlashCommand } from './slash-commands/SlashCommand.js';
 import { ARGUMENT_TYPE, SlashCommandArgument } from './slash-commands/SlashCommandArgument.js';
 import { enumIcons } from './slash-commands/SlashCommandCommonEnumsProvider.js';
 import { SlashCommandEnumValue, enumTypes } from './slash-commands/SlashCommandEnumValue.js';
 import { SlashCommandParser } from './slash-commands/SlashCommandParser.js';
 +import { checkForSystemPromptInInstructTemplate, system_prompts } from './sysprompt.js';
 +import { renderTemplateAsync } from './templates.js';
 import {
     textgenerationwebui_preset_names,
     textgenerationwebui_presets,

  * @param {string} apiId API id
  * @returns {PresetManager} Preset manager
  */
 export function getPresetManager(apiId = '') {
     if (!apiId) {
         apiId = main_api == 'koboldhorde' ? 'kobold' : main_api;
+    }

         this.apiId = apiId;
+    }
 +    static masterSections = {
 +        'instruct': {
 +            name: 'Instruct Template',
 +            getData: () => {
 +                const manager = getPresetManager('instruct');
 +                const name = manager.getSelectedPresetName();
 +                return manager.getPresetSettings(name);
 +            },
 +            setData: (data) => {
 +                const manager = getPresetManager('instruct');
 +                const name = data.name;
 +                return manager.savePreset(name, data);
 +            },
 +            isValid: (data) => PresetManager.isPossiblyInstructData(data),
 +        },
 +        'context': {
 +            name: 'Context Template',
 +            getData: () => {
 +                const manager = getPresetManager('context');
 +                const name = manager.getSelectedPresetName();
 +                return manager.getPresetSettings(name);
 +            },
 +            setData: (data) => {
 +                const manager = getPresetManager('context');
 +                const name = data.name;
 +                return manager.savePreset(name, data);
 +            },
 +            isValid: (data) => PresetManager.isPossiblyContextData(data),
 +        },
 +        'sysprompt': {
 +            name: 'System Prompt',
 +            getData: () => {
 +                const manager = getPresetManager('sysprompt');
 +                const name = manager.getSelectedPresetName();
 +                return manager.getPresetSettings(name);
 +            },
 +            setData: (data) => {
 +                const manager = getPresetManager('sysprompt');
 +                const name = data.name;
 +                return manager.savePreset(name, data);
 +            },
 +            isValid: (data) => PresetManager.isPossiblySystemPromptData(data),
 +        },
 +        'preset': {
 +            name: 'Text Completion Preset',
 +            getData: () => {
 +                const manager = getPresetManager('textgenerationwebui');
 +                const name = manager.getSelectedPresetName();
 +                const data = manager.getPresetSettings(name);
 +                data['name'] = name;
 +                return data;
 +            },
 +            setData: (data) => {
 +                const manager = getPresetManager('textgenerationwebui');
 +                const name = data.name;
 +                return manager.savePreset(name, data);
 +            },
 +            isValid: (data) => PresetManager.isPossiblyTextCompletionData(data),
 +        },
 +    };
++
 +    static isPossiblyInstructData(data) {
 +        const instructProps = ['name', 'input_sequence', 'output_sequence'];
 +        return data && instructProps.every(prop => Object.keys(data).includes(prop));
 +    }
++
 +    static isPossiblyContextData(data) {
 +        const contextProps = ['name', 'story_string'];
 +        return data && contextProps.every(prop => Object.keys(data).includes(prop));
 +    }
++
 +    static isPossiblySystemPromptData(data) {
 +        const sysPromptProps = ['name', 'content'];
 +        return data && sysPromptProps.every(prop => Object.keys(data).includes(prop));
 +    }
++
 +    static isPossiblyTextCompletionData(data) {
 +        const textCompletionProps = ['temp', 'top_k', 'top_p', 'rep_pen'];
 +        return data && textCompletionProps.every(prop => Object.keys(data).includes(prop));
 +    }
++
 +    /**
 +     * Imports master settings from JSON data.
 +     * @param {object} data Data to import
 +     * @param {string} fileName File name
 +     * @returns {Promise<void>}
 +     */
 +    static async performMasterImport(data, fileName) {
 +        if (!data || typeof data !== 'object') {
 +            toastr.error('Invalid data provided for master import');
 +            return;
 +        }
++
 +        // Check for legacy file imports
 +        // 1. Instruct Template
 +        if (this.isPossiblyInstructData(data)) {
 +            toastr.info('Importing instruct template...', 'Instruct template detected');
 +            return await getPresetManager('instruct').savePreset(data.name, data);
 +        }
++
 +        // 2. Context Template
 +        if (this.isPossiblyContextData(data)) {
 +            toastr.info('Importing as context template...', 'Context template detected');
 +            return await getPresetManager('context').savePreset(data.name, data);
 +        }
++
 +        // 3. System Prompt
 +        if (this.isPossiblySystemPromptData(data)) {
 +            toastr.info('Importing as system prompt...', 'System prompt detected');
 +            return await getPresetManager('sysprompt').savePreset(data.name, data);
 +        }
++
 +        // 4. Text Completion settings
 +        if (this.isPossiblyTextCompletionData(data)) {
 +            toastr.info('Importing as settings preset...', 'Text Completion settings detected');
 +            return await getPresetManager('textgenerationwebui').savePreset(fileName, data);
 +        }
++
 +        const validSections = [];
 +        for (const [key, section] of Object.entries(this.masterSections)) {
 +            if (key in data && section.isValid(data[key])) {
 +                validSections.push(key);
 +            }
 +        }
++
 +        if (validSections.length === 0) {
 +            toastr.error('No valid sections found in imported data');
 +            return;
 +        }
++
 +        const sectionNames = validSections.reduce((acc, key) => {
 +            acc[key] = { key: key, name: this.masterSections[key].name, preset: data[key]?.name || '' };
 +            return acc;
 +        }, {});
++
 +        const html = $(await renderTemplateAsync('masterImport', { sections: sectionNames }));
 +        const popup = new Popup(html, POPUP_TYPE.CONFIRM, '', {
 +            okButton: 'Import',
 +            cancelButton: 'Cancel',
 +        });
++
 +        const result = await popup.show();
++
 +        // Import cancelled
 +        if (result !== POPUP_RESULT.AFFIRMATIVE) {
 +            return;
 +        }
++
 +        const importedSections = [];
 +        const confirmedSections = html.find('input:checked').map((_, el) => el instanceof HTMLInputElement && el.value).get();
++
 +        if (confirmedSections.length === 0) {
 +            toastr.info('No sections selected for import');
 +            return;
 +        }
++
 +        for (const section of confirmedSections) {
 +            const sectionData = data[section];
 +            const masterSection = this.masterSections[section];
 +            if (sectionData && masterSection) {
 +                await masterSection.setData(sectionData);
 +                importedSections.push(masterSection.name);
 +            }
 +        }
++
 +        toastr.success(`Imported ${importedSections.length} settings: ${importedSections.join(', ')}`);
 +    }
++
 +    /**
 +     * Exports master settings to JSON data.
 +     * @returns {Promise<string>} JSON data
 +     */
 +    static async performMasterExport() {
 +        const sectionNames = Object.entries(this.masterSections).reduce((acc, [key, section]) => {
 +            acc[key] = { key: key, name: section.name, checked: key !== 'preset' };
 +            return acc;
 +        }, {});
 +        const html = $(await renderTemplateAsync('masterExport', { sections: sectionNames }));
++
 +        const popup = new Popup(html, POPUP_TYPE.CONFIRM, '', {
 +            okButton: 'Export',
 +            cancelButton: 'Cancel',
 +        });
++
 +        const result = await popup.show();
++
 +        // Export cancelled
 +        if (result !== POPUP_RESULT.AFFIRMATIVE) {
 +            return;
 +        }
++
 +        const confirmedSections = html.find('input:checked').map((_, el) => el instanceof HTMLInputElement && el.value).get();
 +        const data = {};
++
 +        if (confirmedSections.length === 0) {
 +            toastr.info('No sections selected for export');
 +            return;
 +        }
++
 +        for (const section of confirmedSections) {
 +            const masterSection = this.masterSections[section];
 +            if (masterSection) {
 +                data[section] = masterSection.getData();
 +            }
 +        }
++
 +        return JSON.stringify(data, null, 4);
 +    }
++
     /**
      * Gets all preset names.
      * @returns {string[]} List of preset names

+    }
     async savePreset(name, settings) {
 +        if (this.apiId === 'instruct' && settings) {
 +            await checkForSystemPromptInInstructTemplate(name, settings);
 +        }
++
 +        if (this.apiId === 'novel' && settings) {
 +            settings = convertNovelPreset(settings);
 +        }
++
         const preset = settings ?? this.getPresetSettings(name);
         const response = await fetch('/api/presets/save', {

                 presets = instruct_presets;
                 preset_names = instruct_presets.map(x => x.name);
                 break;
 +            case 'sysprompt':
 +                presets = system_prompts;
 +                preset_names = system_prompts.map(x => x.name);
 +                break;
             default:
                 console.warn(`Unknown API ID ${this.apiId}`);
+        }

@@ -236,11 +460,11 @@ class PresetManager {
236	460	}
237	461
238	462	isKeyedApi() {
239	463	return this.apiId == 'textgenerationwebui' \|\| this.apiId == 'context' \|\| this.apiId == 'instruct'isAdvancedFormatting();
240	464	}
241	465
242	466	isAdvancedFormatting() {
243	467	return this.apiId == 'context' \|\| this.apiId == 'instruct' \|\| this.apiId == 'sysprompt';
244	468	}
245	469
246	470	updateList(name, preset) {

                     instruct_preset['name'] = name || power_user.instruct.preset;
                     return instruct_preset;
+                }
 +                case 'sysprompt': {
 +                    const sysprompt_preset = structuredClone(power_user.sysprompt);
 +                    sysprompt_preset['name'] = name || power_user.sysprompt.preset;
 +                    return sysprompt_preset;
 +                }
                 default:
                     console.warn(`Unknown API ID ${apiId}`);
                     return {};

             return;
+        }
 -        // default context preset cannot be deleted
 -        if (apiId == 'context' && power_user.default_context === power_user.context.preset) {
 -            return;
 -        }
+-
         const headerText = !presetManager.isAdvancedFormatting() ? 'Delete this preset?' : 'Delete this template?';
         const confirm = await Popup.show.confirm(headerText, 'This action is irreversible and your current settings will be overwritten.');
         if (!confirm) {

             toastr.success(successToast);
+        }
     });
++
 +    $('#af_master_import').on('click', () => {
 +        $('#af_master_import_file').trigger('click');
 +    });
++
 +    $('#af_master_import_file').on('change', async function (e) {
 +        if (!(e.target instanceof HTMLInputElement)) {
 +            return;
 +        }
 +        const file = e.target.files[0];
++
 +        if (!file) {
 +            return;
 +        }
++
 +        const data = await parseJsonFile(file);
 +        const fileName = file.name.replace('.json', '');
 +        await PresetManager.performMasterImport(data, fileName);
 +        e.target.value = null;
 +    });
++
 +    $('#af_master_export').on('click', async () => {
 +        const data = await PresetManager.performMasterExport();
++
 +        if (!data) {
 +            return;
 +        }
++
 +        const shortDate = new Date().toISOString().split('T')[0];
 +        download(data, `ST-formatting-${shortDate}.json`, 'application/json');
 +    });
+}

public/scripts/sysprompt.js+250 -0 Viewed

 +import { saveSettingsDebounced } from '../script.js';
 +import { callGenericPopup, POPUP_TYPE } from './popup.js';
 +import { power_user } from './power-user.js';
 +import { getPresetManager } from './preset-manager.js';
 +import { SlashCommand } from './slash-commands/SlashCommand.js';
 +import { ARGUMENT_TYPE, SlashCommandArgument, SlashCommandNamedArgument } from './slash-commands/SlashCommandArgument.js';
 +import { commonEnumProviders, enumIcons } from './slash-commands/SlashCommandCommonEnumsProvider.js';
 +import { enumTypes, SlashCommandEnumValue } from './slash-commands/SlashCommandEnumValue.js';
 +import { SlashCommandParser } from './slash-commands/SlashCommandParser.js';
 +import { renderTemplateAsync } from './templates.js';
 +import { isTrueBoolean, resetScrollHeight } from './utils.js';
++
 +export let system_prompts = [];
++
 +const $enabled = $('#sysprompt_enabled');
 +const $select = $('#sysprompt_select');
 +const $content = $('#sysprompt_content');
 +const $contentBlock = $('#SystemPromptBlock');
++
 +async function migrateSystemPromptFromInstructMode() {
 +    if ('system_prompt' in power_user.instruct) {
 +        const prompt = String(power_user.instruct.system_prompt);
 +        delete power_user.instruct.system_prompt;
 +        power_user.sysprompt.enabled = power_user.instruct.enabled;
 +        power_user.sysprompt.content = prompt;
++
 +        const existingPromptName = system_prompts.find(x => x.content === prompt)?.name;
++
 +        if (existingPromptName) {
 +            power_user.sysprompt.name = existingPromptName;
 +        } else {
 +            const data = { name: `[Migrated] ${power_user.instruct.preset}`, content: prompt };
 +            await getPresetManager('sysprompt')?.savePreset(data.name, data);
 +            power_user.sysprompt.name = data.name;
 +        }
++
 +        saveSettingsDebounced();
 +        toastr.info('System prompt settings have been moved from the Instruct Mode.', 'Migration notice', { timeOut: 5000 });
 +    }
 +}
++
 +/**
 + * Loads sysprompt settings from the given data object.
 + * @param {object} data Settings data object.
 + */
 +export async function loadSystemPrompts(data) {
 +    if (data.sysprompt !== undefined) {
 +        system_prompts = data.sysprompt;
 +    }
++
 +    await migrateSystemPromptFromInstructMode();
 +    toggleSystemPromptDisabledControls();
++
 +    for (const prompt of system_prompts) {
 +        $('<option>').val(prompt.name).text(prompt.name).appendTo($select);
 +    }
++
 +    $enabled.prop('checked', power_user.sysprompt.enabled);
 +    $select.val(power_user.sysprompt.name);
 +    $content.val(power_user.sysprompt.content);
 +    if (!CSS.supports('field-sizing', 'content')) {
 +        await resetScrollHeight($content);
 +    }
 +}
++
 +/**
 + * Checks if the instruct template has a system prompt and prompts the user to save it as a system prompt.
 + * @param {string} name Name of the instruct template
 + * @param {object} template Instruct template object
 + */
 +export async function checkForSystemPromptInInstructTemplate(name, template) {
 +    if (!template || !name || typeof name !== 'string' || typeof template !== 'object') {
 +        return;
 +    }
 +    if ('system_prompt' in template && template.system_prompt) {
 +        const existingName = system_prompts.find(x => x.content === template.system_prompt)?.name;
 +        const html = await renderTemplateAsync('migrateInstructPrompt', { prompt: template.system_prompt, existing: existingName });
 +        const confirm = await callGenericPopup(html, POPUP_TYPE.CONFIRM);
 +        if (confirm) {
 +            const migratedName = `[Migrated] ${name}`;
 +            const prompt = { name: migratedName, content: template.system_prompt };
 +            const presetManager = getPresetManager('sysprompt');
 +            await presetManager.savePreset(migratedName, prompt);
 +            toastr.success(`System prompt "${migratedName}" has been saved.`);
 +        } else {
 +            toastr.info('System prompt has been discarded.');
 +        }
++
 +        delete template.system_prompt;
 +    }
 +}
++
 +function toggleSystemPromptDisabledControls() {
 +    $enabled.parent().find('i').toggleClass('toggleEnabled', !!power_user.sysprompt.enabled);
 +    $contentBlock.toggleClass('disabled', !power_user.sysprompt.enabled);
 +}
++
 +/**
 + * Sets the system prompt state.
 + * @param {boolean} state System prompt state
 + * @returns {string} Empty string
 + */
 +function setSystemPromptStateCallback(state) {
 +    power_user.sysprompt.enabled = state;
 +    $enabled.prop('checked', state);
 +    toggleSystemPromptDisabledControls();
 +    saveSettingsDebounced();
 +    return '';
 +}
++
 +function toggleSystemPromptCallback(_args, state) {
 +    if (!state || typeof state !== 'string') {
 +        return String(power_user.sysprompt.enabled);
 +    }
++
 +    const newState = isTrueBoolean(state);
 +    setSystemPromptStateCallback(newState);
 +    return String(power_user.sysprompt.enabled);
 +}
++
 +function selectSystemPromptCallback(args, name) {
 +    if (!power_user.sysprompt.enabled && !isTrueBoolean(args.forceGet)) {
 +        return '';
 +    }
++
 +    if (!name) {
 +        return power_user.sysprompt.name ?? '';
 +    }
++
 +    const quiet = isTrueBoolean(args?.quiet);
 +    const systemPromptNames = system_prompts.map(preset => preset.name);
 +    let foundName = systemPromptNames.find(x => x.toLowerCase() === name.toLowerCase());
++
 +    if (!foundName) {
 +        const fuse = new Fuse(systemPromptNames);
 +        const result = fuse.search(name);
++
 +        if (result.length === 0) {
 +            !quiet && toastr.warning(`System prompt "${name}" not found`);
 +            return '';
 +        }
++
 +        foundName = result[0].item;
 +    }
++
 +    $select.val(foundName).trigger('input');
 +    !quiet && toastr.success(`System prompt "${foundName}" selected`);
 +    return foundName;
 +}
++
 +export function initSystemPrompts() {
 +    $enabled.on('input', function () {
 +        power_user.sysprompt.enabled = !!$(this).prop('checked');
 +        toggleSystemPromptDisabledControls();
 +        saveSettingsDebounced();
 +    });
++
 +    $select.on('change', async function () {
 +        if (!power_user.sysprompt.enabled) {
 +            $enabled.prop('checked', true).trigger('input');
 +        }
++
 +        const name = String($(this).val());
 +        const prompt = system_prompts.find(p => p.name === name);
 +        if (prompt) {
 +            $content.val(prompt.content);
 +            if (!CSS.supports('field-sizing', 'content')) {
 +                await resetScrollHeight($content);
 +            }
++
 +            power_user.sysprompt.name = name;
 +            power_user.sysprompt.content = prompt.content;
 +        }
 +        saveSettingsDebounced();
 +    });
++
 +    $content.on('input', function () {
 +        power_user.sysprompt.content = String($(this).val());
 +        saveSettingsDebounced();
 +    });
++
 +    SlashCommandParser.addCommandObject(SlashCommand.fromProps({
 +        name: 'sysprompt',
 +        aliases: ['system-prompt'],
 +        callback: selectSystemPromptCallback,
 +        returns: 'current prompt name',
 +        namedArgumentList: [
 +            SlashCommandNamedArgument.fromProps({
 +                name: 'quiet',
 +                description: 'Suppress the toast message on prompt change',
 +                typeList: [ARGUMENT_TYPE.BOOLEAN],
 +                defaultValue: 'false',
 +                enumList: commonEnumProviders.boolean('trueFalse')(),
 +            }),
 +            SlashCommandNamedArgument.fromProps({
 +                name: 'forceGet',
 +                description: 'Force getting a name even if system prompt is disabled',
 +                typeList: [ARGUMENT_TYPE.BOOLEAN],
 +                defaultValue: 'false',
 +                enumList: commonEnumProviders.boolean('trueFalse')(),
 +            }),
 +        ],
 +        unnamedArgumentList: [
 +            SlashCommandArgument.fromProps({
 +                description: 'system prompt name',
 +                typeList: [ARGUMENT_TYPE.STRING],
 +                enumProvider: () => system_prompts.map(x => new SlashCommandEnumValue(x.name, null, enumTypes.enum, enumIcons.preset)),
 +            }),
 +        ],
 +        helpString: `
 +            <div>
 +                Selects a system prompt by name, using fuzzy search to find the closest match.
 +                Gets the current system prompt if no name is provided and sysprompt is enabled or <code>forceGet=true</code> is passed.
 +            </div>
 +            <div>
 +                <strong>Example:</strong>
 +                <ul>
 +                    <li>
 +                        <pre><code class="language-stscript">/sysprompt </code></pre>
 +                    </li>
 +                </ul>
 +            </div>
 +        `,
 +    }));
 +    SlashCommandParser.addCommandObject(SlashCommand.fromProps({
 +        name: 'sysprompt-on',
 +        aliases: ['sysprompt-enable'],
 +        callback: () => setSystemPromptStateCallback(true),
 +        helpString: 'Enables system prompt.',
 +    }));
 +    SlashCommandParser.addCommandObject(SlashCommand.fromProps({
 +        name: 'sysprompt-off',
 +        aliases: ['sysprompt-disable'],
 +        callback: () => setSystemPromptStateCallback(false),
 +        helpString: 'Disables system prompt',
 +    }));
 +    SlashCommandParser.addCommandObject(SlashCommand.fromProps({
 +        name: 'sysprompt-state',
 +        aliases: ['sysprompt-toggle'],
 +        helpString: 'Gets the current system prompt state. If an argument is provided, it will set the system prompt state.',
 +        unnamedArgumentList: [
 +            SlashCommandArgument.fromProps({
 +                description: 'system prompt state',
 +                typeList: [ARGUMENT_TYPE.BOOLEAN],
 +                enumList: commonEnumProviders.boolean('trueFalse')(),
 +            }),
 +        ],
 +        callback: toggleSystemPromptCallback,
 +    }));
 +}

public/scripts/templates/macros.html+2 -2 Viewed

     <li><tt>&lcub;&lcub;maxPrompt&rcub;&rcub;</tt> – <span data-i18n="help_macros_41">max allowed prompt length in tokens = (context size - response length)</span></li>
     <li><tt>&lcub;&lcub;exampleSeparator&rcub;&rcub;</tt> – <span data-i18n="help_macros_42">context template example dialogues separator</span></li>
     <li><tt>&lcub;&lcub;chatStart&rcub;&rcub;</tt> – <span data-i18n="help_macros_43">context template chat start line</span></li>
     <li><tt>&lcub;&lcub;systemPrompt&rcub;&rcub;</tt> – <span data-i18n="help_macros_44">main system prompt content if enabled (either character prompt override if chosenallowed, or instructSystemPromptdefaultSystemPrompt)</span></li>
     <li><tt>&lcub;&lcub;instructSystemPromptdefaultSystemPrompt&rcub;&rcub;</tt> – <span data-i18n="help_macros_45">instruct system prompt content</span></li>
     <li><tt>&lcub;&lcub;instructSystemPromptPrefix&rcub;&rcub;</tt> – <span data-i18n="help_macros_46">instruct system prompt prefix sequence</span></li>
     <li><tt>&lcub;&lcub;instructSystemPromptSuffix&rcub;&rcub;</tt> – <span data-i18n="help_macros_47">instruct system prompt suffix sequence</span></li>
     <li><tt>&lcub;&lcub;instructUserPrefix&rcub;&rcub;</tt> – <span data-i18n="help_macros_48">instruct user prefix sequence</span></li>

public/scripts/templates/masterExport.html+17 -0 Viewed

 +<h3>
 +    Choose what to export
 +</h3>
 +<div class="flex-container flexFlowColumn justifyLeft">
 +    {{#each sections}}
 +        {{#with this}}
 +            <label class="checkbox_label">
 +                {{#if checked}}
 +                    <input type="checkbox" value="{{key}}" checked />
 +                {{else}}
 +                    <input type="checkbox" value="{{key}}" />
 +                {{/if}}
 +                <span data-i18n="{{name}}">{{name}}</span>
 +            </label>
 +        {{/with}}
 +    {{/each}}
 +</div>

public/scripts/templates/masterImport.html+17 -0 Viewed

 +<h3>
 +    Choose what to import
 +</h3>
 +<div class="flex-container flexFlowColumn justifyLeft">
 +    {{#each sections}}
 +        {{#with this}}
 +            <label class="checkbox_label">
 +                <input type="checkbox" value="{{key}}" checked>
 +                <span data-i18n="{{name}}">{{name}}</span>
 +                {{#if preset}}
 +                    <span>&ndash;</span>
 +                    <small>{{preset}}</small>
 +                {{/if}}
 +            </label>
 +        {{/with}}
 +    {{/each}}
 +</div>

public/scripts/templates/migrateInstructPrompt.html+27 -0 Viewed

 +<h3>
 +    This instruct template also contains a system prompt.
 +</h3>
 +<div>
 +    Would you like to migrate the system prompt from the template?
 +</div>
 +{{#if existing}}
 +<div class="marginTopBot5">
 +    <b>Note:</b>
 +    <span>you already have this prompt saved as:</span>
 +    <span>{{existing}}</span>
 +</div>
 +{{/if}}
 +<div class="justifyLeft marginTop5">
 +    <div>
 +        <small>
 +            <b>"Yes"</b> &ndash; The prompt will be imported and selected as a current system prompt.
 +        </small>
++
 +    </div>
 +    <div>
 +        <small>
 +            <b>"No"</b> &ndash; The prompt will be ignored, no changes to the current system prompt.
 +        </small>
 +    </div>
 +</div>
 +<textarea class="wide100p textarea_compact" rows="10">{{prompt}}</textarea>

public/scripts/templates/welcome.html+0 -5 Viewed

             SillyTavern Documentation Site
         </a>
     </li>
 -    <li>
 -        <a target="_blank" href="https://docs.sillytavern.app/extras/installation/" data-i18n="Extras Installation Guide">
 -            Extras Installation Guide
 -        </a>
 -    </li>
 </ul>
 <hr>

public/scripts/textgen-settings.js+10 -4 Viewed

 import { power_user, registerDebugFunction } from './power-user.js';
 import { getEventSourceStream } from './sse-stream.js';
 import { getCurrentDreamGenModelTokenizer, getCurrentOpenRouterModelTokenizer } from './textgen-models.js';
 import { SENTENCEPIECE_TOKENIZERSENCODE_TOKENIZERS, TEXTGEN_TOKENIZERS, getTextTokens, tokenizers } from './tokenizers.js';
 import { getSortableDelay, onlyUnique } from './utils.js';
 export {

@@ -353,7 +353,7 @@ function getTokenizerForTokenIds() {
353	353	return tokenizers.API_CURRENT;
354	354	}
355	355
356	356	if (SENTENCEPIECE_TOKENIZERSENCODE_TOKENIZERS.includes(power_user.tokenizer)) {
357	357	return power_user.tokenizer;
358	358	}
359	359

         'frequency_penalty': settings.freq_pen,
         'presence_penalty': settings.presence_pen,
         'repetition_penalty': settings.rep_pen,
         'seed': settings.seed >= 0 ? settings.seed : undefined,
         'stop': getStoppingStrings(isImpersonate, isContinue),
 -        'temperature': settings.temp,
 +        'temperature': dynatemp ? (settings.min_temp + settings.max_temp) / 2 : settings.temp,
         'temperature_last': settings.temperature_last,
         'top_p': settings.top_p,
         'top_k': settings.top_k,

         'guided_json': settings.json_schema,
         'early_stopping': false, // hacks
         'include_stop_str_in_output': false,
 +        'dynatemp_min': dynatemp ? settings.min_temp : undefined,
 +        'dynatemp_max': dynatemp ? settings.max_temp : undefined,
 +        'dynatemp_exponent': dynatemp ? settings.dynatemp_exponent : undefined,
 +        'xtc_threshold': settings.xtc_threshold,
 +        'xtc_probability': settings.xtc_probability,
 +        'custom_token_bans': toIntArray(banned_tokens),
     };
     if (settings.type === OPENROUTER) {

public/scripts/tokenizers.js+34 -9 Viewed

 const { OOBA, TABBY, KOBOLDCPP, VLLM, APHRODITE, LLAMACPP, OPENROUTER, DREAMGEN } = textgen_types;
 export const CHARACTERS_PER_TOKEN_RATIO = 3.35;
 export const TOKENIZER_WARNING_KEY = 'tokenizationWarningShown';
 +export const TOKENIZER_SUPPORTED_KEY = 'tokenizationSupported';
 export const tokenizers = {
     NONE: 0,

     JAMBA: 14,
     QWEN2: 15,
     COMMAND_R: 16,
 +    NEMO: 17,
     BEST_MATCH: 99,
 };
 -export const SENTENCEPIECE_TOKENIZERS = [
 +// A list of local tokenizers that support encoding and decoding token ids.
 +export const ENCODE_TOKENIZERS = [
     tokenizers.LLAMA,
     tokenizers.MISTRAL,
     tokenizers.YI,
     tokenizers.LLAMA3,
     tokenizers.GEMMA,
     tokenizers.JAMBA,
 +    tokenizers.QWEN2,
 +    tokenizers.COMMAND_R,
 +    tokenizers.NEMO,
     // uncomment when NovelAI releases Kayra and Clio weights, lol
     //tokenizers.NERD,
     //tokenizers.NERD2,
 ];
 +// A list of Text Completion sources that support remote tokenization.
 export const TEXTGEN_TOKENIZERS = [OOBA, TABBY, KOBOLDCPP, LLAMACPP, VLLM, APHRODITE];
 const TOKENIZER_URLS = {

         decode: '/api/tokenizers/command-r/decode',
         count: '/api/tokenizers/command-r/encode',
     },
 +    [tokenizers.NEMO]: {
 +        encode: '/api/tokenizers/nemo/encode',
 +        decode: '/api/tokenizers/nemo/decode',
 +        count: '/api/tokenizers/nemo/encode',
 +    },
     [tokenizers.API_TEXTGENERATIONWEBUI]: {
         encode: '/api/tokenizers/remote/textgenerationwebui/encode',
         count: '/api/tokenizers/remote/textgenerationwebui/encode',

@@ -262,6 +274,9 @@ export function getTokenizerBestMatch(forApi) {
262	274	if (nai_settings.model_novel.includes('kayra')) {
263	275	return tokenizers.NERD2;
264	276	}
	277	+ if (nai_settings.model_novel.includes('erato')) {
	278	+ return tokenizers.LLAMA3;
	279	+ }
265	280	}
266	281	if (forApi === 'kobold' \|\| forApi === 'textgenerationwebui' \|\| forApi === 'koboldhorde') {
267	282	// Try to use the API tokenizer if possible:

         // - Kobold must pass a version check
         // - Tokenizer haven't reported an error previously
         const hasTokenizerError = sessionStorage.getItem(TOKENIZER_WARNING_KEY);
 +        const hasValidEndpoint = sessionStorage.getItem(TOKENIZER_SUPPORTED_KEY);
         const isConnected = online_status !== 'no_connection';
         const isTokenizerSupported = TEXTGEN_TOKENIZERS.includes(textgen_settings.type) && (textgen_settings.type !== OOBA || hasValidEndpoint);
         if (!hasTokenizerError && isConnected) {
             if (forApi === 'kobold' && kai_flags.can_use_tokenization) {

     const jambaTokenizer = 'jamba';
     const qwen2Tokenizer = 'qwen2';
     const commandRTokenizer = 'command-r';
 +    const nemoTokenizer = 'nemo';
     // Assuming no one would use it for different models.. right?
     if (oai_settings.chat_completion_source == chat_completion_sources.SCALE) {

@@ -624,6 +641,9 @@ export function getTokenizerModel() {
624	641	}
625	642
626	643	if (oai_settings.chat_completion_source == chat_completion_sources.MISTRALAI) {
	644	+ if (oai_settings.mistralai_model.includes('nemo') \|\| oai_settings.mistralai_model.includes('pixtral')) {
	645	+ return nemoTokenizer;
	646	+ }
627	647	return mistralTokenizer;
628	648	}
629	649

 function apiFailureTokenCount(str) {
     console.error('Error counting tokens');
 +    let shouldTryAgain = false;
     if (!sessionStorage.getItem(TOKENIZER_WARNING_KEY)) {
 -        toastr.warning(
 +        const bestMatchBefore = getTokenizerBestMatch(main_api);
 -            'Your selected API doesn\'t support the tokenization endpoint. Using estimated counts.',
 -            'Error counting tokens',
 -            { timeOut: 10000, preventDuplicates: true },
 -        );
+-
         sessionStorage.setItem(TOKENIZER_WARNING_KEY, String(true));
 +        const bestMatchAfter = getTokenizerBestMatch(main_api);
 +        if ([tokenizers.API_TEXTGENERATIONWEBUI, tokenizers.API_KOBOLD].includes(bestMatchBefore) && bestMatchBefore !== bestMatchAfter) {
 +            shouldTryAgain = true;
 +        }
 +    }
++
 +    // Only try again if we guarantee not to be looped by the same error
 +    if (shouldTryAgain && power_user.tokenizer === tokenizers.BEST_MATCH) {
 +        return getTokenCount(str);
+    }
     return guesstimate(str);

public/scripts/utils.js+6 -12 Viewed

 /**
  * Trims a string to the end of a nearest sentence.
  * @param {string} input The string to trim.
 - * @param {boolean} include_newline Whether to include a newline character in the trimmed string.
  * @returns {string} The trimmed string.
  * @example
  * trimToEndSentence('Hello, world! I am from'); // 'Hello, world!'
  */
 export function trimToEndSentence(input, include_newline = false) {
     if (!input) {
         return '';
+    }

@@ -633,11 +632,6 @@ export function trimToEndSentence(input, include_newline = false) {
633	632	}
634	633	break;
635	634	}
636		-
637		- if (include_newline && char === '\n') {
638		- last = i;
639		- break;
640		- }
641	635	}
642	636
643	637	if (last === -1) {

  * @returns {string} The html representation of the highlighted regex
  */
 export function highlightRegex(regexStr) {
     // Function to escape HTML special characters for safety or readability
     const escapeHtmlescape = (str) => str.replace(/[&<>"'\x01]/g, match => ({
         '&': '&amp;', '<': '&lt;', '>': '&gt;', '"': '&quot;', '\'': '&#39;', '\x01': '\\x01',
     })[match]);
     // Replace special characters with their HTML-escaped forms
     regexStr = escapeHtmlescape(regexStr);
     // Patterns that we want to highlight only if they are not escaped
     function getPatterns() {

public/scripts/world-info.js+72 -10 Viewed

             depth = MAX_SCAN_DEPTH;
+        }
         const JOINERMATCHER = '\n\x01';
 -        let result = this.#depthBuffer.slice(this.#startDepth, depth).join(JOINER);
 +        const JOINER = '\n' + MATCHER;
 +        let result = MATCHER + this.#depthBuffer.slice(this.#startDepth, depth).join(JOINER);
         if (this.#injectBuffer.length > 0) {
             result += JOINER + this.#injectBuffer.join(JOINER);

     preventRecursionInput.prop('checked', entry.preventRecursion).trigger('input');
     // delay until recursion
 +    // delay until recursion level
     const delayUntilRecursionInput = template.find('input[name="delay_until_recursion"]');
     delayUntilRecursionInput.data('uid', entry.uid);
 +    const delayUntilRecursionLevelInput = template.find('input[name="delayUntilRecursionLevel"]');
 +    delayUntilRecursionLevelInput.data('uid', entry.uid);
     delayUntilRecursionInput.on('input', async function () {
         const uid = $(this).data('uid');
         const valuetoggled = $(this).prop('checked');
++
 +        // If the value contains a number, we'll take that one (set by the level input), otherwise we can use true/false switch
 +        const value = toggled ? data.entries[uid].delayUntilRecursion || true : false;
++
 +        if (!toggled) delayUntilRecursionLevelInput.val('');
++
         data.entries[uid].delayUntilRecursion = value;
         setWIOriginalDataValue(data, uid, 'extensions.delay_until_recursion', data.entries[uid].delayUntilRecursion);
         await saveWorldInfo(name, data);
     });
     delayUntilRecursionInput.prop('checked', entry.delayUntilRecursion).trigger('input');
 +    delayUntilRecursionLevelInput.on('input', async function () {
 +        const uid = $(this).data('uid');
 +        const content = $(this).val();
 +        const value = content === '' ? (typeof data.entries[uid].delayUntilRecursion === 'boolean' ? data.entries[uid].delayUntilRecursion : true)
 +            : content === 1 ? true
 +                : !isNaN(Number(content)) ? Number(content)
 +                    : false;
++
 +        data.entries[uid].delayUntilRecursion = value;
 +        setWIOriginalDataValue(data, uid, 'extensions.delay_until_recursion', data.entries[uid].delayUntilRecursion);
 +        await saveWorldInfo(name, data);
 +    });
 +    // No need to retrigger inpout event, we'll just set the curret current value. It was edited/saved above already
 +    delayUntilRecursionLevelInput.val(['number', 'string'].includes(typeof entry.delayUntilRecursion) ? entry.delayUntilRecursion : '').trigger('input');
     // duplicate button
     const duplicateButton = template.find('.duplicate_entry_button');

     disable: { default: false, type: 'boolean' },
     excludeRecursion: { default: false, type: 'boolean' },
     preventRecursion: { default: false, type: 'boolean' },
     delayUntilRecursion: { default: false0, type: 'booleannumber' },
     probability: { default: 100, type: 'number' },
     useProbability: { default: true, type: 'boolean' },
     depth: { default: DEFAULT_DEPTH, type: 'number' },

@@ -3696,6 +3720,7 @@ export async function checkWorldInfo(chat, maxContext, isDryRun) {
3696	3720	}
3697	3721	}
3698	3722
	3723	+ /** @type {scan_state} */
3699	3724	let scanState = scan_state.INITIAL;
3700	3725	let token_budget_overflowed = false;
3701	3726	let count = 0;

         return { worldInfoBefore: '', worldInfoAfter: '', WIDepthEntries: [], EMEntries: [], allActivatedEntries: new Set() };
+    }
 +    /** @type {number[]} Represents the delay levels for entries that are delayed until recursion */
 +    const availableRecursionDelayLevels = [...new Set(sortedEntries
 +        .filter(entry => entry.delayUntilRecursion)
 +        .map(entry => entry.delayUntilRecursion === true ? 1 : entry.delayUntilRecursion),
 +    )].sort((a, b) => a - b);
 +    // Already preset with the first level
 +    let currentRecursionDelayLevel = availableRecursionDelayLevels.shift() ?? 0;
 +    if (currentRecursionDelayLevel > 0 && availableRecursionDelayLevels.length) {
 +        console.debug('[WI] Preparing first delayed recursion level', currentRecursionDelayLevel, '. Still delayed:', availableRecursionDelayLevels);
 +    }
++
     console.debug(`[WI] --- SEARCHING ENTRIES (on ${sortedEntries.length} entries) ---`);
     while (scanState) {

         // Track how many times the loop has run. May be useful for debugging.
         count++;
         console.debug(`[WI] Loop--- LOOP #${count}. SearchSTART state---`, Object.entries(scan_state).find(x => x[1] === scanState));
 +        console.debug('[WI] Scan state', Object.entries(scan_state).find(x => x[1] === scanState));
         // Until decided otherwise, we set the loop to stop scanning after this
         let nextScanState = scan_state.NONE;

                 continue;
+            }
 +            if (scanState === scan_state.RECURSION && entry.delayUntilRecursion && entry.delayUntilRecursion > currentRecursionDelayLevel && !isSticky) {
 +                log('suppressed by delay until recursion level', entry.delayUntilRecursion, '. Currently', currentRecursionDelayLevel);
 +                continue;
 +            }
++
             if (scanState === scan_state.RECURSION && world_info_recursive && entry.excludeRecursion && !isSticky) {
                 log('suppressed by exclude recursion');
                 continue;

         filterByInclusionGroups(newEntries, allActivatedEntries, buffer, scanState, timedEffects);
         console.debug('[WI] --- PROBABILITY CHECKS ---');
 +        !newEntries.length && console.debug('[WI] No probability checks to do');
++
         for (const entry of newEntries) {
             function verifyProbability() {
                 // If we don't need to roll, it's always true

             newContent += `${entry.content}\n`;
             if ((textToScanTokens + (await getTokenCountAsync(newContent))) >= budget) {
 +                console.debug('[WI] --- BUDGET OVERFLOW CHECK ---');
                 if (world_info_overflow_alert) {
                     console.warn(`[WI] budget of ${budget} reached, stopping after ${allActivatedEntries.size} entries`);
                     toastr.warning(`World info budget reached after ${allActivatedEntries.size} entries.`, 'World Info');

         const successfulNewEntries = newEntries.filter(x => !failedProbabilityChecks.has(x));
         const successfulNewEntriesForRecursion = successfulNewEntries.filter(x => !x.preventRecursion);
 +        console.debug(`[WI] --- LOOP #${count} RESULT ---`);
         if (!newEntries.length) {
             console.debug('[WI] No new entries activated, stopping.');
         } else if (!successfulNewEntries.length) {
             console.debug('[WI] Probability checks failed for all activated entries,. stoppingNo new entries activated.');
         } else {
             console.debug(`[WI] Successfully activated ${successfulNewEntries.length} new entries to prompt. ${allActivatedEntries.size} total entries activated.`, successfulNewEntries);
+        }
 +        function logNextState(...args) {
 +            args.length && console.debug(args.shift(), ...args);
 +            console.debug('[WI] Setting scan state', Object.entries(scan_state).find(x => x[1] === scanState));
 +        }
++
         // After processing and rolling entries is done, see if we should continue with normal recursion
         if (world_info_recursive && !token_budget_overflowed && successfulNewEntriesForRecursion.length) {
             nextScanState = scan_state.RECURSION;
 +            logNextState('[WI] Found', successfulNewEntriesForRecursion.length, 'new entries for recursion');
+        }
         // If we are inside min activations scan, and we have recursive buffer, we should do a recursive scan before increasing the buffer again
         // There might be recurse-trigger-able entries that match the buffer, so we need to check that
         if (world_info_recursive && !token_budget_overflowed && scanState === scan_state.MIN_ACTIVATIONS && buffer.hasRecurse()) {
             nextScanState = scan_state.RECURSION;
 +            logNextState('[WI] Min Activations run done, whill will always be followed by a recursive scan');
+        }
         // If scanning is planned to stop, but min activations is set and not satisfied, check if we should continue

             ) || (buffer.getDepth() > chat.length);
             if (!over_max) {
 -                console.debug(`[WI] Min activations not reached (${allActivatedEntries.size}/${world_info_min_activations}), advancing depth to ${buffer.getDepth() + 1} and checking again`);
                 nextScanState = scan_state.MIN_ACTIVATIONS; // loop
 +                logNextState(`[WI] Min activations not reached (${allActivatedEntries.size}/${world_info_min_activations}), advancing depth to ${buffer.getDepth() + 1}, starting another scan`);
                 buffer.advanceScan();
             } else {
                 console.debug(`[WI] Min activations not reached (${allActivatedEntries.size}/${world_info_min_activations}), but reached on of depth. Stopping`);
+            }
+        }
 +        // If the scan is done, but we still have open "delay until recursion" levels, we should continue with the next one
 +        if (nextScanState === scan_state.NONE && availableRecursionDelayLevels.length) {
 +            nextScanState = scan_state.RECURSION;
 +            currentRecursionDelayLevel = availableRecursionDelayLevels.shift();
 +            logNextState('[WI] Open delayed recursion levels left. Preparing next delayed recursion level', currentRecursionDelayLevel, '. Still delayed:', availableRecursionDelayLevels);
 +        }
++
         // Final check if we should really continue scan, and extend the current WI recurse buffer
         scanState = nextScanState;
         if (scanState) {

@@ -4046,6 +4106,8 @@ export async function checkWorldInfo(chat, maxContext, isDryRun) {
4046	4106	.map(x => x.content).join('\n');
4047	4107	buffer.addRecurse(text);
4048	4108	allActivatedText = (text + '\n' + allActivatedText);
	4109	+ } else {
	4110	+ logNextState('[WI] Scan done. No new entries to prompt. Stopping.');
4049	4111	}
4050	4112	}
4051	4113

         switch (entry.position) {
             case world_info_position.before:
                 WIBeforeEntries.unshift(substituteParams(content));
                 break;
             case world_info_position.after:
                 WIAfterEntries.unshift(substituteParams(content));
                 break;
             case world_info_position.EMTop:
                 EMEntries.unshift(

public/style.css+25 -11 Viewed

 /*#################################################################*/
 select {
+-
 +    -moz-appearance: none;
 -    padding: 3px 2px;
 +    -webkit-appearance: none;
 +    appearance: none;
 +    padding: 3px 5px;
     background-color: var(--black30a);
     border: 1px solid var(--SmartThemeBorderColor);
     border-radius: 5px;
     margin-bottom: 5px;
     height: min-content;
 +    background-image: url('/img/down-arrow.svg');
 +    background-repeat: no-repeat;
 +    background-position: right 6px center;
 +    background-size: 8px 5px;
+}
 select option {
     /* works to highlight selected/active option */
     background-color: var(--white50a);
     color: var(--black70a);
+-
+}
 select option:not(:checked) {

     color: var(--active) !important;
+}
 -#context_set_default.default {
 -    color: var(--preferred) !important;
 -}
+-
 -#instruct_set_default.default {
 -    color: var(--preferred) !important;
 -}
+-
 .displayBlock {
     display: block !important;
+}

     column-gap: 20px;
+}
 +.horde-model-description {
 +    -webkit-line-clamp: 3;
 +    line-clamp: 3;
 +    font-size: 0.9em;
 +    overflow: hidden;
 +    text-overflow: ellipsis;
 +}
++
 .drag-handle {
     cursor: grab;
     /* Make the drag handle not selectable in most browsers */

 #AdvancedFormatting .autoSetHeight {
     overflow-wrap: anywhere;
+}
++
 +#InstructSequencesColumn summary {
 +    font-size: 0.95em;
 +    cursor: pointer;
 +}
++
 +#InstructSequencesColumn details:not(:last-of-type) {
 +    margin-bottom: 5px;
 +}

server.js+4 -0 Viewed

 // Ooba/OpenAI text completions
 app.use('/api/backends/text-completions', require('./src/endpoints/backends/text-completions').router);
 +// OpenRouter
 +app.use('/api/openrouter', require('./src/endpoints/openrouter').router);
++
 // KoboldAI
 app.use('/api/backends/kobold', require('./src/endpoints/backends/kobold').router);

 userModule.initUserStorage(dataRoot)
     .then(userModule.ensurePublicDirectoriesExist)
     .then(userModule.migrateUserData)
 +    .then(userModule.migrateSystemPrompts)
     .then(verifySecuritySettings)
     .then(preSetupTasks)
     .finally(startServer);

src/constants.js+1 -2 Viewed

     extensions: 'public/scripts/extensions',
 };
 -const DEFAULT_AVATAR = '/img/ai4.png';
 const SETTINGS_FILE = 'settings.json';
 /**

     files: 'user/files',
     vectors: 'vectors',
     backups: 'backups',
 +    sysprompt: 'sysprompt',
 });
 /**

 module.exports = {
     DEFAULT_USER,
 -    DEFAULT_AVATAR,
     SETTINGS_FILE,
     PUBLIC_DIRECTORIES,
     USER_DIRECTORY_TEMPLATE,

src/endpoints/backends/text-completions.js+1 -0 Viewed

                     const modelName = modelInfo?.model_name;
                     result = modelName || result;
 +                    response.setHeader('x-supports-tokenization', 'true');
+                }
             } catch (error) {
                 console.error(`Failed to get Ooba model info: ${error}`);

src/endpoints/characters.js+7 -2 Viewed

         const char = JSON.stringify(charaFormatData(request.body, request.user.directories));
         const internalName = getPngName(request.body.ch_name, request.user.directories);
         const avatarName = `${internalName}.png`;
 -        const defaultAvatar = './public/img/ai4.png';
         const chatsPath = path.join(request.user.directories.chats, internalName);
         if (!fs.existsSync(chatsPath)) fs.mkdirSync(chatsPath);
         if (!request.file) {
             await writeCharacterData(defaultAvatardefaultAvatarPath, char, internalName, request);
             return response.send(avatarName);
         } else {
             const crop = tryParse(request.query.crop);

                 const stats = fs.statSync(pathToFile);
                 const fileSizeInKB = `${(stats.size / 1024).toFixed(2)}kb`;
 +                if (stats.size === 0) {
 +                    console.log(`Found an empty chat file: ${pathToFile}`);
 +                    res({});
 +                    return;
 +                }
++
                 const rl = readline.createInterface({
                     input: fileStream,
                     crlfDelay: Infinity,

src/endpoints/chats.js+99 -42 Viewed

 const express = require('express');
 const sanitize = require('sanitize-filename');
 const writeFileAtomicSync = require('write-file-atomic').sync;
 +const _ = require('lodash');
 const { jsonParser, urlencodedParser } = require('../express-common');
 const { getConfigValue, humanizedISO8601DateTime, tryParse, generateTimestamp, removeOldBackups } = require('../util');

+    }
+}
 +const backupFunctions = new Map();
++
 +/**
 + * Gets a backup function for a user.
 + * @param {string} handle User handle
 + * @returns {function(string, string, string): void} Backup function
 + */
 +function getBackupFunction(handle) {
 +    const throttleInterval = getConfigValue('chatBackupThrottleInterval', 10_000);
 +    if (!backupFunctions.has(handle)) {
 +        backupFunctions.set(handle, _.throttle(backupChat, throttleInterval, { leading: true, trailing: true }));
 +    }
 +    return backupFunctions.get(handle);
 +}
++
 +process.on('exit', () => {
 +    for (const func of backupFunctions.values()) {
 +        func.flush();
 +    }
 +});
++
 /**
  * Imports a chat from Ooba's format.
  * @param {string} userName User name

@@ -70,8 +92,7 @@ function importOobaChat(userName, characterName, jsonData) {
70	92	}
71	93	}
72	94
73	95	const chatContent =return chat.map(obj => JSON.stringify(obj)).join('\n');
74		- return chatContent;
75	96	}
76	97
77	98	/**

@@ -99,8 +120,7 @@ function importAgnaiChat(userName, characterName, jsonData) {
99	120	});
100	121	}
101	122
102	123	const chatContent =return chat.map(obj => JSON.stringify(obj)).join('\n');
103		- return chatContent;
104	124	}
105	125
106	126	/**

     return newChats;
+}
 +/**
 + * Flattens `msg` and `swipes` data from Chub Chat format.
 + * Only changes enough to make it compatible with the standard chat serialization format.
 + * @param {string} userName User name
 + * @param {string} characterName Character name
 + * @param {string[]} lines serialised JSONL data
 + * @returns {string} Converted data
 + */
 +function flattenChubChat(userName, characterName, lines) {
 +    function flattenSwipe(swipe) {
 +        return swipe.message ? swipe.message : swipe;
 +    }
++
 +    function convert(line) {
 +        const lineData = tryParse(line);
 +        if (!lineData) return line;
++
 +        if (lineData.mes && lineData.mes.message) {
 +            lineData.mes = lineData?.mes.message;
 +        }
++
 +        if (lineData?.swipes && Array.isArray(lineData.swipes)) {
 +            lineData.swipes = lineData.swipes.map(swipe => flattenSwipe(swipe));
 +        }
++
 +        return JSON.stringify(lineData);
 +    }
++
 +    return (lines ?? []).map(convert).join('\n');
 +}
++
 const router = express.Router();
 router.post('/save', jsonParser, function (request, response) {

         const directoryName = String(request.body.avatar_url).replace('.png', '');
         const chatData = request.body.chat;
         const jsonlData = chatData.map(JSON.stringify).join('\n');
         const fileName = `${sanitize(String(request.body.file_name))}.jsonl`;
         const filePath = path.join(request.user.directories.chats, directoryName, sanitize(fileName));
         writeFileAtomicSync(filePath, jsonlData, 'utf8');
         backupChatgetBackupFunction(request.user.profile.handle)(request.user.directories.backups, directoryName, jsonlData);
         return response.send({ result: 'ok' });
     } catch (error) {
         response.send(error);

             return response.send({});
+        }
         const fileName = path.join(directoryPath, `${sanitize(String(request.body.file_name))}.jsonl`);
         const chatFileExistsfilePath = fspath.existsSyncjoin(directoryPath, sanitize(fileName));
 +        const chatFileExists = fs.existsSync(filePath);
         if (!chatFileExists) {
             return response.send({});
+        }
         const data = fs.readFileSync(fileNamefilePath, 'utf8');
         const lines = data.split('\n');
         // Iterate through the array of strings and parse each line as JSON

     const pathToFolder = request.body.is_group
         ? request.user.directories.groupChats
         : path.join(request.user.directories.chats, String(request.body.avatar_url).replace('.png', ''));
     const pathToOriginalFile = path.join(pathToFolder, sanitize(request.body.original_file));
     const pathToRenamedFile = path.join(pathToFolder, sanitize(request.body.renamed_file));
 +    const sanitizedFileName = path.parse(pathToRenamedFile).name;
     console.log('Old chat name', pathToOriginalFile);
     console.log('New chat name', pathToRenamedFile);

     fs.copyFileSync(pathToOriginalFile, pathToRenamedFile);
     fs.rmSync(pathToOriginalFile);
     console.log('Successfully renamed.');
     return response.send({ ok: true, sanitizedFileName });
 });
 router.post('/delete', jsonParser, function (request, response) {
 -    if (!request.body) {
 -        console.log('no request body seen');
 -        return response.sendStatus(400);
 -    }
+-
 -    if (request.body.chatfile !== sanitize(request.body.chatfile)) {
 -        console.error('Malicious chat name prevented');
 -        return response.sendStatus(403);
 -    }
+-
     const dirName = String(request.body.avatar_url).replace('.png', '');
     const fileName = path.join(request.user.directories.chats, dirName, sanitize(String(request.body.chatfile)));
     const chatFileExistsfilePath = fspath.existsSyncjoin(request.user.directories.chats, dirName, sanitize(fileName));
 +    const chatFileExists = fs.existsSync(filePath);
     if (!chatFileExists) {
         console.log(`Chat file not found '${fileNamefilePath}'`);
         return response.sendStatus(400);
 -    } else {
 -        fs.rmSync(fileName);
 -        console.log('Deleted chat file: ' + fileName);
+    }
 +    fs.rmSync(filePath);
 +    console.log('Deleted chat file: ' + filePath);
     return response.send('ok');
 });

+    }
     try {
         // Short path for JSONL files
         if (request.body.format === 'jsonl') {
             try {
                 const rawFile = fs.readFileSync(filename, 'utf8');
                 const successMessage = {

                 console.log(`Chat exported as ${exportfilename}`);
                 return response.status(200).json(successMessage);
 -            }
 +            } catch (err) {
 -            catch (err) {
                 console.error(err);
                 const errorMessage = {
                     message: `Could not read JSONL file to export. Source chat file: ${filename}.`,

             console.log(`Chat exported as ${exportfilename}`);
             return response.status(200).json(successMessage);
         });
 -    }
 +    } catch (err) {
 -    catch (err) {
         console.log('chat export failed.');
         console.log(err);
         return response.sendStatus(400);

+        }
         if (format === 'jsonl') {
             constlet linelines = data.split('\n')[0];
 +            const header = lines[0];
++
 +            const jsonData = JSON.parse(header);
++
 +            if (!(jsonData.user_name !== undefined || jsonData.name !== undefined)) {
 +                console.log('Incorrect chat format .jsonl');
 +                return response.send({ error: true });
 +            }
 -            const jsonData = JSON.parse(line);
 +            // Do a tiny bit of work to import Chub Chat data
 +            // Processing the entire file is so fast that it's not worth checking if it's a Chub chat first
 +            let flattenedChat = data;
 +            try {
 +                // flattening is unlikely to break, but it's not worth failing to
 +                // import normal chats in an attempt to import a Chub chat
 +                flattenedChat = flattenChubChat(userName, characterName, lines);
 +            } catch (error) {
 +                console.warn('Failed to flatten Chub Chat data: ', error);
 +            }
 -            if (jsonData.user_name !== undefined || jsonData.name !== undefined) {
             const fileName = `${characterName} - ${humanizedISO8601DateTime()} imported.jsonl`;
             const filePath = path.join(request.user.directories.chats, avatarUrl, fileName);
 +            if (flattenedChat !== data) {
 +                writeFileAtomicSync(filePath, flattenedChat, 'utf8');
 +            } else {
                 fs.copyFileSync(pathToUpload, filePath);
 +            }
             fs.unlinkSync(pathToUpload);
             response.send({ res: true });
 -            } else {
 -                console.log('Incorrect chat format .jsonl');
 -                return response.send({ error: true });
 -            }
+        }
     } catch (error) {
         console.error(error);

     let chat_data = request.body.chat;
     let jsonlData = chat_data.map(JSON.stringify).join('\n');
     writeFileAtomicSync(pathToFile, jsonlData, 'utf8');
     backupChatgetBackupFunction(request.user.profile.handle)(request.user.directories.backups, String(id), jsonlData);
     return response.send({ ok: true });
 });

src/endpoints/content-manager.js+40 -1 Viewed

     CONTEXT: 'context',
     MOVING_UI: 'moving_ui',
     QUICK_REPLIES: 'quick_replies',
 +    SYSPROMPT: 'sysprompt',
 };
 /**

         const presets = [];
         for (const contentItem of contentIndex) {
             if (contentItem.type.endsWith('_preset') || contentItem.type === 'instruct' || contentItem.type === 'context' || contentItem.type === 'sysprompt') {
                 contentItem.name = path.parse(contentItem.filename).name;
                 contentItem.folder = getTargetByType(contentItem.type, directories);
                 presets.push(contentItem);

+}
 /**
 + * Gets content by type and format.
 + * @param {string} type Type of content
 + * @param {'json'|'string'|'raw'} format Format of content
 + * @returns {string[]|Buffer[]} Array of content
 + */
 +function getContentOfType(type, format) {
 +    const contentIndex = getContentIndex();
 +    const indexItems = contentIndex.filter((item) => item.type === type && item.folder);
 +    const files = [];
 +    for (const item of indexItems) {
 +        if (!item.folder) {
 +            continue;
 +        }
 +        try {
 +            const filePath = path.join(item.folder, item.filename);
 +            const fileContent = fs.readFileSync(filePath);
 +            switch (format) {
 +                case 'json':
 +                    files.push(JSON.parse(fileContent.toString()));
 +                    break;
 +                case 'string':
 +                    files.push(fileContent.toString());
 +                    break;
 +                case 'raw':
 +                    files.push(fileContent);
 +                    break;
 +            }
 +        } catch {
 +            // Ignore errors
 +        }
 +    }
 +    return files;
 +}
++
 +/**
  * Gets the target directory for the specified asset type.
  * @param {ContentType} type Asset type
  * @param {import('../users').UserDirectoryList} directories User directories

             return directories.movingUI;
         case CONTENT_TYPES.QUICK_REPLIES:
             return directories.quickreplies;
 +        case CONTENT_TYPES.SYSPROMPT:
 +            return directories.sysprompt;
         default:
             return null;
+    }

     checkForNewContent,
     getDefaultPresets,
     getDefaultPresetFile,
 +    getContentOfType,
     router,
 };

src/endpoints/horde.js+29 -4 Viewed

 const { jsonParser } = require('../express-common');
 const ANONYMOUS_KEY = '0000000000';
 +const HORDE_TEXT_MODEL_METADATA_URL = 'https://raw.githubusercontent.com/db0/AI-Horde-text-model-reference/main/db.json';
 const cache = new Cache(60 * 1000);
 const router = express.Router();

  * @returns {Promise<AIHorde>} AIHorde client
  */
 async function getHordeClient() {
     const ai_horde =return new AIHorde({
         client_agent: await getClientAgent(),
     });
 -    return ai_horde;
+}
 /**

+    }
 });
 +async function getHordeTextModelMetadata() {
 +    const response = await fetch(HORDE_TEXT_MODEL_METADATA_URL);
 +    return await response.json();
 +}
++
 +async function mergeModelsAndMetadata(models, metadata) {
 +    return models.map(model => {
 +        const metadataModel = metadata[model.name];
 +        if (!metadataModel) {
 +            return  { ...model, is_whitelisted: false };
 +        }
 +        return { ...model, ...metadataModel, is_whitelisted: true };
 +    });
 +}
++
 router.post('/text-models', jsonParser, async (request, response) => {
     try {
         const cachedModels = cache.get('models');
+-
         if (cachedModels && !request.body.force) {
             return response.send(cachedModels);
+        }

             },
         });
         constlet data = await fetchResult.json();
++
 +        // attempt to fetch and merge models metadata
 +        try {
 +            const metadata = await getHordeTextModelMetadata();
 +            data = await mergeModelsAndMetadata(data, metadata);
 +        }
 +        catch (error) {
 +            console.error('Failed to fetch metadata:', error);
 +        }
++
         cache.set('models', data);
         return response.send(data);
     } catch (error) {

         console.log('Stable Horde request:', request.body);
         const ai_horde = await getHordeClient();
 +        // noinspection JSCheckFunctionSignatures -- see @ts-ignore - use_gfpgan
         const generation = await ai_horde.postAsyncImageGenerate(
+            {
                 prompt: `${request.body.prompt} ### ${request.body.negative_prompt}`,

src/endpoints/novelai.js+67 -12 Viewed

     [19438], [43145], [26523], [41471], [2936], [85, 85], [49332], [7286], [1115], [24],
 ];
 +const eratoBadWordsList = [
 +    [16067], [933, 11144], [25106, 11144], [58, 106901, 16073, 33710, 25, 109933],
 +    [933, 58, 11144], [128030], [58, 30591, 33503, 17663, 100204, 25, 11144],
 +];
++
 const hypeBotBadWordsList = [
     [58], [60], [90], [92], [685], [1391], [1782], [2361], [3693], [4083], [4357], [4895],
     [5512], [5974], [7131], [8183], [8351], [8762], [8964], [8973], [9063], [11208],

 , 1040, 49209, 4, 5, 6, 7, 8, 9, 10, 11, 12],
 ];
 +const eratoRepPenWhitelist = [
 +    6, 1, 11, 13, 25, 198, 12, 9, 8, 279, 264, 459, 323, 477, 539, 912, 374, 574, 1051, 1550, 1587, 4536, 5828, 15058,
 +    3287, 3250, 1461, 1077, 813, 11074, 872, 1202, 1436, 7846, 1288, 13434, 1053, 8434, 617, 9167, 1047, 19117, 706,
 +    12775, 649, 4250, 527, 7784, 690, 2834, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 1210, 1359, 608, 220, 596, 956,
 +    3077, 44886, 4265, 3358, 2351, 2846, 311, 389, 315, 304, 520, 505, 430
 +];
++
 // Ban the dinkus and asterism
 const logitBiasExp = [
     { 'sequence': [23], 'bias': -0.08, 'ensure_sequence_finish': false, 'generate_once': false },
     { 'sequence': [21], 'bias': -0.08, 'ensure_sequence_finish': false, 'generate_once': false },
 ];
 +const eratoLogitBiasExp = [
 +    { 'sequence': [12488], 'bias': -0.08, 'ensure_sequence_finish': false, 'generate_once': false },
 +    { 'sequence': [128041], 'bias': -0.08, 'ensure_sequence_finish': false, 'generate_once': false },
 +];
++
 function getBadWordsList(model) {
     let list = [];

         list = badWordsList;
+    }
 +    if (model.includes('erato')) {
 +        list = eratoBadWordsList;
 +    }
++
     // Clone the list so we don't modify the original
     return list.slice();
+}
 +function getLogitBiasList(model) {
 +    let list = [];
++
 +    if (model.includes('erato')) {
 +        list = eratoLogitBiasExp;
 +    }
++
 +    if (model.includes('clio') || model.includes('kayra')) {
 +        list = logitBiasExp;
 +    }
++
 +    return list.slice();
 +}
++
 +function getRepPenaltyWhitelist(model) {
 +    if (model.includes('clio') || model.includes('kayra')) {
 +        return repPenaltyAllowList.flat();
 +    }
++
 +    if (model.includes('erato')) {
 +        return eratoRepPenWhitelist.flat();
 +    }
++
 +    return null;
 +}
++
 const router = express.Router();
 router.post('/status', jsonParser, async function (req, res) {

         controller.abort();
     });
 -    const isNewModel = (req.body.model.includes('clio') || req.body.model.includes('kayra'));
 +    // Add customized bad words for Clio, Kayra, and Erato
     const badWordsList = getBadWordsList(req.body.model);
 -    // Add customized bad words for Clio and Kayra
 +    if (Array.isArray(badWordsList) && Array.isArray(req.body.bad_words_ids)) {
 -    if (isNewModel && Array.isArray(req.body.bad_words_ids)) {
         for (const badWord of req.body.bad_words_ids) {
             if (Array.isArray(badWord) && badWord.every(x => Number.isInteger(x))) {
                 badWordsList.push(badWord);

+    }
     // Add default biases for dinkus and asterism
 -    const logit_bias_exp = isNewModel ? logitBiasExp.slice() : [];
 +    const logitBiasList = getLogitBiasList(req.body.model);
     if (Array.isArray(logit_bias_explogitBiasList) && Array.isArray(req.body.logit_bias_exp)) {
         logit_bias_explogitBiasList.push(...req.body.logit_bias_exp);
+    }
 +    const repPenWhitelist = getRepPenaltyWhitelist(req.body.model);
++
     const data = {
         'input': req.body.input,
         'model': req.body.model,

             'repetition_penalty_slope': req.body.repetition_penalty_slope,
             'repetition_penalty_frequency': req.body.repetition_penalty_frequency,
             'repetition_penalty_presence': req.body.repetition_penalty_presence,
             'repetition_penalty_whitelist': isNewModel ? repPenaltyAllowList.flat() : nullrepPenWhitelist,
             'top_a': req.body.top_a,
             'top_p': req.body.top_p,
             'top_k': req.body.top_k,
             'typical_p': req.body.typical_p,
             'mirostat_lr': req.body.mirostat_lr,
             'mirostat_tau': req.body.mirostat_tau,
 -            'cfg_scale': req.body.cfg_scale,
 -            'cfg_uc': req.body.cfg_uc,
             'phrase_rep_pen': req.body.phrase_rep_pen,
             'stop_sequences': req.body.stop_sequences,
             'bad_words_ids': badWordsList.length ? badWordsList : null,
             'logit_bias_exp': logit_bias_explogitBiasList,
             'generate_until_sentence': req.body.generate_until_sentence,
             'use_cache': req.body.use_cache,
             'return_full_text': req.body.return_full_text,
             'prefix': req.body.prefix,
             'order': req.body.order,
             'num_logprobs': req.body.num_logprobs,
 +            'min_p': req.body.min_p,
 +            'math1_temp': req.body.math1_temp,
 +            'math1_quad': req.body.math1_quad,
 +            'math1_quad_entropy_scale': req.body.math1_quad_entropy_scale,
         },
     };
     // Tells the model to stop generation at '>'
     if ('theme_textadventure' === req.body.prefix && isNewModel) {
 +        if (req.body.model.includes('clio') || req.body.model.includes('kayra')) {
             data.parameters.eos_token_id = 49405;
+        }
 +        if (req.body.model.includes('erato')) {
 +            data.parameters.eos_token_id = 29;
 +        }
 +    }
     console.log(util.inspect(data, { depth: 4 }));

     };
     try {
         const baseURL = (req.body.model.includes('kayra') || req.body.model.includes('erato')) ? TEXT_NOVELAI : API_NOVELAI;
         const url = req.body.streaming ? `${baseURL}/ai/generate-stream` : `${baseURL}/ai/generate`;
         const response = await fetch(url, { method: 'POST', timeout: 0, ...args });

src/endpoints/openai.js+8 -0 Viewed

             key = readSecret(request.user.directories, SECRET_KEYS.ZEROONEAI);
+        }
 +        if (request.body.api === 'mistral') {
 +            key = readSecret(request.user.directories, SECRET_KEYS.MISTRALAI);
 +        }
++
         if (!key && !request.body.reverse_proxy && ['custom', 'ooba', 'koboldcpp', 'vllm'].includes(request.body.api) === false) {
             console.log('No key found for API', request.body.api);
             return response.sendStatus(400);

             apiUrl = 'https://api.01.ai/v1/chat/completions';
+        }
 +        if (request.body.api === 'mistral') {
 +            apiUrl = 'https://api.mistral.ai/v1/chat/completions';
 +        }
++
         if (request.body.api === 'ooba') {
             apiUrl = `${trimV1(request.body.server_url)}/v1/chat/completions`;
             const imgMessage = body.messages.pop();

src/endpoints/openrouter.js+32 -0 Viewed

 +const express = require('express');
 +const { jsonParser } = require('../express-common');
++
 +const router = express.Router();
 +const API_OPENROUTER = 'https://openrouter.ai/api/v1';
++
 +router.post('/models/multimodal', jsonParser, async (_req, res) => {
 +    try {
 +        // The endpoint is available without authentication
 +        const response = await fetch(`${API_OPENROUTER}/models`, {
 +            method: 'GET',
 +            headers: {
 +                'Accept': 'application/json',
 +            },
 +        });
++
 +        if (!response.ok) {
 +            return res.json([]);
 +        }
++
 +        const data = await response.json();
 +        const models = data?.data || [];
 +        const multimodalModels = models.filter(m => m?.architecture?.modality === 'text+image->text').map(m => m.id);
++
 +        return res.json(multimodalModels);
 +    } catch (error) {
 +        console.error(error);
 +        return res.sendStatus(500);
 +    }
 +});
++
 +module.exports = { router };

src/endpoints/presets.js+2 -0 Viewed

             return { folder: directories.instruct, extension: '.json' };
         case 'context':
             return { folder: directories.context, extension: '.json' };
 +        case 'sysprompt':
 +            return { folder: directories.sysprompt, extension: '.json' };
         default:
             return { folder: null, extension: null };
+    }

src/endpoints/settings.js+2 -0 Viewed

     const instruct = readAndParseFromDirectory(request.user.directories.instruct);
     const context = readAndParseFromDirectory(request.user.directories.context);
 +    const sysprompt = readAndParseFromDirectory(request.user.directories.sysprompt);
     response.send({
         settings,

         quickReplyPresets,
         instruct,
         context,
 +        sysprompt,
         enable_extensions: ENABLE_EXTENSIONS,
         enable_extensions_auto_update: ENABLE_EXTENSIONS_AUTO_UPDATE,
         enable_accounts: ENABLE_ACCOUNTS,

src/endpoints/tokenizers.js+24 -0 Viewed

 const llama3_tokenizer = new WebTokenizer('src/tokenizers/llama3.json');
 const commandTokenizer = new WebTokenizer('https://github.com/SillyTavern/SillyTavern-Tokenizers/raw/main/command-r.json', 'src/tokenizers/llama3.json');
 const qwen2Tokenizer = new WebTokenizer('https://github.com/SillyTavern/SillyTavern-Tokenizers/raw/main/qwen2.json', 'src/tokenizers/llama3.json');
 +const nemoTokenizer = new WebTokenizer('https://github.com/SillyTavern/SillyTavern-Tokenizers/raw/main/nemo.json', 'src/tokenizers/llama3.json');
 const sentencepieceTokenizers = [
     'llama',

@@ -418,6 +419,10 @@ function getTokenizerModel(requestModel) {
418	419	return 'command-r';
419	420	}
420	421
	422	+ if (requestModel.includes('nemo')) {
	423	+ return 'nemo';
	424	+ }
	425	+
421	426	// default
422	427	return 'gpt-3.5-turbo';
423	428	}

 router.post('/llama3/encode', jsonParser, createWebTokenizerEncodingHandler(llama3_tokenizer));
 router.post('/qwen2/encode', jsonParser, createWebTokenizerEncodingHandler(qwen2Tokenizer));
 router.post('/command-r/encode', jsonParser, createWebTokenizerEncodingHandler(commandTokenizer));
 +router.post('/nemo/encode', jsonParser, createWebTokenizerEncodingHandler(nemoTokenizer));
 router.post('/llama/decode', jsonParser, createSentencepieceDecodingHandler(spp_llama));
 router.post('/nerdstash/decode', jsonParser, createSentencepieceDecodingHandler(spp_nerd));
 router.post('/nerdstash_v2/decode', jsonParser, createSentencepieceDecodingHandler(spp_nerd_v2));

 router.post('/llama3/decode', jsonParser, createWebTokenizerDecodingHandler(llama3_tokenizer));
 router.post('/qwen2/decode', jsonParser, createWebTokenizerDecodingHandler(qwen2Tokenizer));
 router.post('/command-r/decode', jsonParser, createWebTokenizerDecodingHandler(commandTokenizer));
 +router.post('/nemo/decode', jsonParser, createWebTokenizerDecodingHandler(nemoTokenizer));
 router.post('/openai/encode', jsonParser, async function (req, res) {
     try {

             return handler(req, res);
+        }
 +        if (queryModel.includes('nemo')) {
 +            const handler = createWebTokenizerEncodingHandler(nemoTokenizer);
 +            return handler(req, res);
 +        }
++
         const model = getTokenizerModel(queryModel);
         const handler = createTiktokenEncodingHandler(model);
         return handler(req, res);

             return handler(req, res);
+        }
 +        if (queryModel.includes('nemo')) {
 +            const handler = createWebTokenizerDecodingHandler(nemoTokenizer);
 +            return handler(req, res);
 +        }
++
         const model = getTokenizerModel(queryModel);
         const handler = createTiktokenDecodingHandler(model);
         return handler(req, res);

             return res.send({ 'token_count': num_tokens });
+        }
 +        if (model === 'nemo') {
 +            const instance = await nemoTokenizer.get();
 +            if (!instance) throw new Error('Failed to load the Nemo tokenizer');
 +            num_tokens = countWebTokenizerTokens(instance, req.body);
 +            return res.send({ 'token_count': num_tokens });
 +        }
++
         const tokensPerName = queryModel.includes('gpt-3.5-turbo-0301') ? -1 : 1;
         const tokensPerMessage = queryModel.includes('gpt-3.5-turbo-0301') ? 4 : 3;
         const tokensPadding = 3;

src/endpoints/vectors.js+105 -88 Viewed

 const express = require('express');
 const sanitize = require('sanitize-filename');
 const { jsonParser } = require('../express-common');
 +const { getConfigValue, color } = require('../util');
 // Don't forget to add new sources to the SOURCES array
 const SOURCES = [

+}
 /**
 + * Extracts settings for the vectorization sources from the HTTP request headers.
 + * @param {string} source - Which source to extract settings for.
 + * @param {object} request - The HTTP request object.
 + * @returns {object} - An object that can be used as `sourceSettings` in functions that take that parameter.
 + */
 +function getSourceSettings(source, request) {
 +    switch (source) {
 +        case 'togetherai':
 +            return {
 +                model: String(request.headers['x-togetherai-model']),
 +            };
 +        case 'openai':
 +            return {
 +                model: String(request.headers['x-openai-model']),
 +            };
 +        case 'cohere':
 +            return {
 +                model: String(request.headers['x-cohere-model']),
 +            };
 +        case 'llamacpp':
 +            return {
 +                apiUrl: String(request.headers['x-llamacpp-url']),
 +            };
 +        case 'vllm':
 +            return {
 +                apiUrl: String(request.headers['x-vllm-url']),
 +                model: String(request.headers['x-vllm-model']),
 +            };
 +        case 'ollama':
 +            return {
 +                apiUrl: String(request.headers['x-ollama-url']),
 +                model: String(request.headers['x-ollama-model']),
 +                keep: Boolean(request.headers['x-ollama-keep']),
 +            };
 +        case 'extras':
 +            return {
 +                extrasUrl: String(request.headers['x-extras-url']),
 +                extrasKey: String(request.headers['x-extras-key']),
 +            };
 +        case 'local':
 +            return {
 +                model: getConfigValue('extras.embeddingModel', ''),
 +            };
 +        case 'palm':
 +            return {
 +                // TODO: Add support for multiple models
 +                model: 'text-embedding-004',
 +            };
 +        default:
 +            return {};
 +    }
 +}
++
 +/**
 + * Gets the model scope for the source.
 + * @param {object} sourceSettings - The settings for the source
 + * @returns {string} The model scope for the source
 + */
 +function getModelScope(sourceSettings) {
 +    const scopesEnabled = getConfigValue('vectors.enableModelScopes', false);
 +    const warningShown = global.process.env.VECTORS_MODEL_SCOPE_WARNING_SHOWN === 'true';
++
 +    if (!scopesEnabled && !warningShown) {
 +        console.log();
 +        console.warn(color.red('[DEPRECATION NOTICE]'), 'Model scopes for Vectore Storage are disabled, but will soon be required.');
 +        console.log(`To enable model scopes, set the ${color.cyan('vectors.enableModelScopes')} in config.yaml to ${color.green(true)}.`);
 +        console.log('This message won\'t be shown again in the current session.');
 +        console.log();
 +        global.process.env.VECTORS_MODEL_SCOPE_WARNING_SHOWN = 'true';
 +    }
++
 +    return scopesEnabled ? (sourceSettings?.model || '') : '';
 +}
++
 +/**
  * Gets the index for the vector collection
  * @param {import('../users').UserDirectoryList} directories - User directories
  * @param {string} collectionId - The collection ID
  * @param {string} source - The source of the vector
  * @param {booleanobject} createsourceSettings - WhetherThe tomodel createfor the index if it doesn't existsource
  * @returns {Promise<vectra.LocalIndex>} - The index for the collection
  */
 async function getIndex(directories, collectionId, source, create = truesourceSettings) {
 -    const pathToFile = path.join(directories.vectors, sanitize(source), sanitize(collectionId));
 +    const model = getModelScope(sourceSettings);
 +    const pathToFile = path.join(directories.vectors, sanitize(source), sanitize(collectionId), sanitize(model));
     const store = new vectra.LocalIndex(pathToFile);
     if (create && !await store.isIndexCreated()) {
         await store.createIndex();
+    }

  * @param {{ hash: number; text: string; index: number; }[]} items - The items to insert
  */
 async function insertVectorItems(directories, collectionId, source, sourceSettings, items) {
     const store = await getIndex(directories, collectionId, source, sourceSettings);
     await store.beginUpdate();

  * @param {import('../users').UserDirectoryList} directories - User directories
  * @param {string} collectionId - The collection ID
  * @param {string} source - The source of the vector
 + * @param {Object} sourceSettings - Settings for the source, if it needs any
  * @returns {Promise<number[]>} - The hashes of the items in the collection
  */
 async function getSavedHashes(directories, collectionId, source, sourceSettings) {
     const store = await getIndex(directories, collectionId, source, sourceSettings);
     const items = await store.listItems();
     const hashes = items.map(x => Number(x.metadata.hash));

  * @param {import('../users').UserDirectoryList} directories - User directories
  * @param {string} collectionId - The collection ID
  * @param {string} source - The source of the vector
 + * @param {Object} sourceSettings - Settings for the source, if it needs any
  * @param {number[]} hashes - The hashes of the items to delete
  */
 async function deleteVectorItems(directories, collectionId, source, sourceSettings, hashes) {
     const store = await getIndex(directories, collectionId, source, sourceSettings);
     const items = await store.listItemsByMetadata({ hash: { '$in': hashes } });
     await store.beginUpdate();

  * @returns {Promise<{hashes: number[], metadata: object[]}>} - The metadata of the items that match the search text
  */
 async function queryCollection(directories, collectionId, source, sourceSettings, searchText, topK, threshold) {
     const store = await getIndex(directories, collectionId, source, sourceSettings);
     const vector = await getVector(source, sourceSettings, searchText, true, directories);
     const result = await store.queryItems(vector, topK);

     const results = [];
     for (const collectionId of collectionIds) {
         const store = await getIndex(directories, collectionId, source, sourceSettings);
         const result = await store.queryItems(vector, topK);
         results.push(...result.map(result => ({ collectionId, result })));
+    }

+}
 /**
 - * Extracts settings for the vectorization sources from the HTTP request headers.
 - * @param {string} source - Which source to extract settings for.
 - * @param {object} request - The HTTP request object.
 - * @returns {object} - An object that can be used as `sourceSettings` in functions that take that parameter.
 - */
 -function getSourceSettings(source, request) {
 -    if (source === 'togetherai') {
 -        const model = String(request.headers['x-togetherai-model']);
+-
 -        return {
 -            model: model,
 -        };
 -    } else if (source === 'openai') {
 -        const model = String(request.headers['x-openai-model']);
+-
 -        return {
 -            model: model,
 -        };
 -    } else if (source === 'cohere') {
 -        const model = String(request.headers['x-cohere-model']);
+-
 -        return {
 -            model: model,
 -        };
 -    } else if (source === 'llamacpp') {
 -        const apiUrl = String(request.headers['x-llamacpp-url']);
+-
 -        return {
 -            apiUrl: apiUrl,
 -        };
 -    } else if (source === 'vllm') {
 -        const apiUrl = String(request.headers['x-vllm-url']);
 -        const model = String(request.headers['x-vllm-model']);
+-
 -        return {
 -            apiUrl: apiUrl,
 -            model: model,
 -        };
 -    } else if (source === 'ollama') {
 -        const apiUrl = String(request.headers['x-ollama-url']);
 -        const model = String(request.headers['x-ollama-model']);
 -        const keep = Boolean(request.headers['x-ollama-keep']);
+-
 -        return {
 -            apiUrl: apiUrl,
 -            model: model,
 -            keep: keep,
 -        };
 -    } else {
 -        // Extras API settings to connect to the Extras embeddings provider
 -        let extrasUrl = '';
 -        let extrasKey = '';
 -        if (source === 'extras') {
 -            extrasUrl = String(request.headers['x-extras-url']);
 -            extrasKey = String(request.headers['x-extras-key']);
 -        }
+-
 -        return {
 -            extrasUrl: extrasUrl,
 -            extrasKey: extrasKey,
 -        };
 -    }
 -}
+-
 -/**
  * Performs a request to regenerate the index if it is corrupted.
  * @param {import('express').Request} req Express request object
  * @param {import('express').Response} res Express response object

     if (error instanceof SyntaxError && !req.query.regenerated) {
         const collectionId = String(req.body.collectionId);
         const source = String(req.body.source) || 'transformers';
 +        const sourceSettings = getSourceSettings(source, req);
         if (collectionId && source) {
             const index = await getIndex(req.user.directories, collectionId, source, falsesourceSettings);
             const exists = await index.isIndexCreated();
             if (exists) {

 const router = express.Router();
 +router.get('/scopes-enabled', (_req, res) => {
 +    const scopesEnabled = getConfigValue('vectors.enableModelScopes', false);
 +    return res.json({ enabled: scopesEnabled });
 +});
++
 router.post('/query', jsonParser, async (req, res) => {
     try {
         if (!req.body.collectionId || !req.body.searchText) {

         const collectionId = String(req.body.collectionId);
         const source = String(req.body.source) || 'transformers';
 +        const sourceSettings = getSourceSettings(source, req);
         const hashes = await getSavedHashes(req.user.directories, collectionId, source, sourceSettings);
         return res.json(hashes);
     } catch (error) {
         return regenerateCorruptedIndexErrorHandler(req, res, error);

         const collectionId = String(req.body.collectionId);
         const hashes = req.body.hashes.map(x => Number(x));
         const source = String(req.body.source) || 'transformers';
 +        const sourceSettings = getSourceSettings(source, req);
         await deleteVectorItems(req.user.directories, collectionId, source, sourceSettings, hashes);
         return res.sendStatus(200);
     } catch (error) {
         return regenerateCorruptedIndexErrorHandler(req, res, error);

         const collectionId = String(req.body.collectionId);
         for (const source of SOURCES) {
             const indexsourcePath = await getIndexpath.join(req.user.directories, collectionId.vectors, sanitize(source), falsesanitize(collectionId));
+-
 +            if (!fs.existsSync(sourcePath)) {
 -            const exists = await index.isIndexCreated();
+-
 -            if (!exists) {
                 continue;
+            }
+-
 +            await fs.promises.rm(sourcePath, { recursive: true });
 -            const path = index.folderPath;
 +            console.log(`Deleted vector index at ${sourcePath}`);
 -            await index.deleteIndex();
 -            console.log(`Deleted vector index at ${path}`);
+        }
         return res.sendStatus(200);

src/prompt-converters.js+3 -0 Viewed

         'gemini-1.5-flash',
         'gemini-1.5-flash-latest',
         'gemini-1.5-flash-001',
 +        'gemini-1.5-flash-002',
         'gemini-1.5-flash-exp-0827',
         'gemini-1.5-flash-8b-exp-0827',
 +        'gemini-1.5-flash-8b-exp-0924',
         'gemini-1.5-pro',
         'gemini-1.5-pro-latest',
         'gemini-1.5-pro-001',
 +        'gemini-1.5-pro-002',
         'gemini-1.5-pro-exp-0801',
         'gemini-1.5-pro-exp-0827',
         'gemini-1.0-pro-vision-latest',

src/users.js+63 -4 Viewed

 const express = require('express');
 const mime = require('mime-types');
 const archiver = require('archiver');
 +const writeFileAtomicSync = require('write-file-atomic').sync;
 +const _ = require('lodash');
 const { USER_DIRECTORY_TEMPLATE, DEFAULT_USER, PUBLIC_DIRECTORIES, DEFAULT_AVATAR, SETTINGS_FILE } = require('./constants');
 const { getConfigValue, color, delay, setConfigValue, generateTimestamp } = require('./util');
 const { readSecret, writeSecret } = require('./endpoints/secrets');

  * @type {Map<string, UserDirectoryList>}
  */
 const DIRECTORIES_CACHE = new Map();
 +const PUBLIC_USER_AVATAR = '/img/default-user.png';
 const STORAGE_KEYS = {
     csrfSecret: 'csrfSecret',

  * @property {string} files - The directory where the uploaded files are stored
  * @property {string} vectors - The directory where the vectors are stored
  * @property {string} backups - The directory where the backups are stored
 + * @property {string} sysprompt - The directory where the system prompt data is stored
  */
 /**

     console.log(color.green('Migration completed!'));
+}
 +async function migrateSystemPrompts() {
 +    /**
 +     * Gets the default system prompts.
 +     * @returns {Promise<any[]>} - The list of default system prompts
 +     */
 +    async function getDefaultSystemPrompts() {
 +        try {
 +            const { getContentOfType } = await import('./endpoints/content-manager.js');
 +            return getContentOfType('sysprompt', 'json');
 +        } catch {
 +            return [];
 +        }
 +    }
++
 +    const directories = await getUserDirectoriesList();
 +    for (const directory of directories) {
 +        try {
 +            const migrateMarker = path.join(directory.sysprompt, '.migrated');
 +            if (fs.existsSync(migrateMarker)) {
 +                continue;
 +            }
 +            const defaultPrompts = await getDefaultSystemPrompts();
 +            const instucts = fs.readdirSync(directory.instruct);
 +            let migratedPrompts = [];
 +            for (const instruct of instucts) {
 +                const instructPath = path.join(directory.instruct, instruct);
 +                const sysPromptPath = path.join(directory.sysprompt, instruct);
 +                if (path.extname(instruct) === '.json' && !fs.existsSync(sysPromptPath)) {
 +                    const instructData = JSON.parse(fs.readFileSync(instructPath, 'utf8'));
 +                    if ('system_prompt' in instructData && 'name' in instructData) {
 +                        const syspromptData = { name: instructData.name, content: instructData.system_prompt };
 +                        migratedPrompts.push(syspromptData);
 +                        delete instructData.system_prompt;
 +                        writeFileAtomicSync(instructPath, JSON.stringify(instructData, null, 4));
 +                    }
 +                }
 +            }
 +            // Only leave unique contents
 +            migratedPrompts = _.uniqBy(migratedPrompts, 'content');
 +            // Only leave contents that are not in the default prompts
 +            migratedPrompts = migratedPrompts.filter(x => !defaultPrompts.some(y => y.content === x.content));
 +            for (const sysPromptData of migratedPrompts) {
 +                sysPromptData.name = `[Migrated] ${sysPromptData.name}`;
 +                const syspromptPath = path.join(directory.sysprompt, `${sysPromptData.name}.json`);
 +                writeFileAtomicSync(syspromptPath, JSON.stringify(sysPromptData, null, 4));
 +                console.log(`Migrated system prompt ${sysPromptData.name} for ${directory.root.split(path.sep).pop()}`);
 +            }
 +            writeFileAtomicSync(migrateMarker, '');
 +        } catch {
 +            // Ignore errors
 +        }
 +    }
 +}
++
 /**
  * Converts a user handle to a storage key.
  * @param {string} handle User handle

         const settings = fs.existsSync(pathToSettings) ? JSON.parse(fs.readFileSync(pathToSettings, 'utf8')) : {};
         const avatarFile = settings?.power_user?.default_persona || settings?.user_avatar;
         if (!avatarFile) {
             return DEFAULT_AVATARPUBLIC_USER_AVATAR;
+        }
         const avatarPath = path.join(directory.avatars, avatarFile);
         if (!fs.existsSync(avatarPath)) {
             return DEFAULT_AVATARPUBLIC_USER_AVATAR;
+        }
         const mimeType = mime.lookup(avatarPath);
         const base64Content = fs.readFileSync(avatarPath, 'base64');

@@ -490,7 +548,7 @@ async function getUserAvatar(handle) {
490	548	}
491	549	catch {
492	550	// Ignore errors
493	551	return DEFAULT_AVATARPUBLIC_USER_AVATAR;
494	552	}
495	553	}
496	554

     requireLoginMiddleware,
     requireAdminMiddleware,
     migrateUserData,
 +    migrateSystemPrompts,
     getPasswordSalt,
     getPasswordHash,
     getCsrfSecret,

start.sh+1 -1 Viewed

 echo "Installing Node Modules..."
 export NODE_ENV=production
 npm i --no-audit --no-fund --quietloglevel=error --no-progress --omit=dev
 echo "Entering SillyTavern..."
 node "server.js" "$@"

Merge branch 'staging' into deprecate-cc-or-instruct