TavLite: Lightweight Open-Source AI Roleplay Chat Tool (Supports OSR2, SR6)

, ,

TavLite is an open-source local AI chat application that allows users to freely create, edit, and manage character cards, enabling a highly customizable role-playing experience.

GitHub: https://github.com/Karasukaigan/TavLite

Features

  • Compatible with most LLM APIs

  • Suitable for both mobile and desktop use

  • Supports integration with ComfyUI for text-to-image generation

  • Character card management (create, edit, delete)

  • Simpler and more lightweight than SillyTavern

Character Card Selection Page

Character Card Management Page

OSR

Installation

Suggestions

  1. Please deploy TavLite only within a local area network (LAN), and do not deploy it on a cloud server.

  2. If you plan to use Ollama, make sure the model is already loaded on the Ollama side before sending requests (you can verify this by running ollama ps and checking that the model is loaded), to avoid the first conversation getting stuck or becoming unresponsive.

  3. If you want to try the text-to-image feature, ensure that the required model exists on the ComfyUI server and that the model name is entered correctly, for example SDXL\illustrij_v18.safetensors (pay attention to the slash direction). Also confirm that the ComfyUI server port is configured correctly. It is recommended to use the latest version of ComfyUI and deploy it from source rather than using ComfyUI Portable. In addition, before submitting the workflow, it is best to preload the required models into VRAM or system memory to avoid request timeouts caused by slow model loading.

  4. The current prompts are not yet well-optimized, and different models may interpret prompts differently, so you may need to test and adjust them yourself.

License

This project is licensed under the MIT License.

Here are my other projects

1 Like