Sillytavern settings reddit And there don't seem to be any other proxy front ends out there for windows other than sillytavern. But why doesn't sillytavern support lm studio? lm studio's interface is extremely basic, it doesn't support character cards and many of the nicer features that koboldcpp and faraday do. Is there a better setting? This subreddit has gone Restricted and reference-only as part of a mass protest against Reddit's recent API changes, which break third-party apps and Get the Reddit app Scan this QR code to download the app now. Kayra with the right settings to me is superior to gpt 3. I need help, can anyone screenshot your settings on sillytavern? Share Add a Comment. Locate the config. Care to share "Text Completion presets", "Context Template" and "Instruct Mode" for this model? /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper A place to discuss the SillyTavern fork of TavernAI. I've been using SillyTavern for nearly two months now, and I use it exclusively for a chatbot. However it's starting to feel A place to discuss the SillyTavern fork of TavernAI. So I thought it might be a good idea to gather best settings for it. 1 /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper A place to discuss the SillyTavern fork of TavernAI. (not sure if it had to do something with my temp settings etc). N00b here who’s kinda overwhelmed with all the options available in the app. Copy and paste/replace this version over the existing one, which I believe is in the main directory iirc. If you have any settings you recommend, please do share them aswell. 9. My default loading format is 5. Read the Doc, refer to the Doc, make it your ST bible! (ST is short for SillyTavern. Make sure you have instruct mode turned on as well. /r/StableDiffusion **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I tried ChatML in oobabooga, and character was calm, quite talkative, but completely ignoring me, just focused on own things. Here is the system prompt i use: **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. I just changed out the settings for some other settings for Smaug and it's now doing pretty good. my experimented settings areMax Response Length = 400Temperature=0. 8 which is under more active development, and has These are the settings I have currently with Sillytavern running Goliath120b through Mancer, but sometimes I get outputs from it where it adds emojis, or mispells words, or runs away with the chat. In your phone, navigate back to your regular storage (or SD card) and create an easily to find folder where you will copy your SillyTavern settings in. The Doc has installation instructions. 4th - recommendation for formatting characters cards. . I will be adding a section to sillytavernai. SillyTavern is a fork of **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. If anything ever gets removed by reddit, replace the "re" in the reddit URL to "un" so it's "unddit" instead of "reddit" **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. So, I suggest switching models until SillyTavern properly implements the Novel AI models, or sticking to their website. Just switched over to the WizardLM-2-8x22 Q4KM quant and didn't change one setting from my mindight-miqu settings. In short, download koboldcpp, download that model in gguf variant and you can already use it. things about this model, so I decided to try it through the InfermaticAI subscription, but I feel like I dont have the settings quite right yet. Personally, I do a lot of testing, so to make any meaningful comparisons, I need deterministic settings to reduce the number of variables and eliminate randomness as much as **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. or the best settings for the application or even maybe the backend, I'd really SillyTavern is a fork of TavernAI 1. 002/per 1K tokens. 10. There you will find a settings. and that was after **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Open comment sort options /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. Developer-supported and community-run. Increased the limit of snapshots to 50 per user. Then, install sillytavern, connect to it, select the llama3 context and instruct (also make sure you use the instruct mode), select universal light preset for samplers and you're ready to start your (e)rp after getting some characters from chub. I use mainly pro-writer and pilotfish presets. While I don't often use the text adventure mode for NovelAI (last time I used it was with Sigurd. 8 which is under more active development, and has added many major A place to discuss the SillyTavern fork of TavernAI. Command-r settings . However, even after searching around for answers, I couldn't find the optimal settings for A place to discuss the SillyTavern fork of TavernAI. Or check it out in the app stores A place to discuss the SillyTavern fork of TavernAI. This subreddit has gone Restricted and reference-only as part of a mass protest against Reddit's recent API changes, which break third-party apps and moderation tools. then there is probably something wrong with your settings, prompt or character card. ), I don't think it would be worth converting into SillyTavern unless you plan on using a larger LLM, taking the time to setup Stable Diffusion (For images), or want to completely switch to chatbot versus **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. ai. Oh great idea with the "slow paced" style. Here is an example I am using right now with a Get the Reddit app Scan this QR code to download the app now. Edit: current settings are in the "Public" folder. yaml file in the SillyTavern folder. 5 and 4. In the User Settings tab, under Theme Settings, there's a drop-down menu called Chat Style. This sub has no connection to the Discord server, nor does this sub **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Reddit's home for all things related A place to discuss the SillyTavern fork of TavernAI. If you only have a simple question or want to start a small discussion, head over to our weekly discussion thread which is pinned on our front page and updated weekly! **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. cpp to know that this must have something to do with the format of how the instructions are being given to SillyTavern, but in the settings section (sorry, not on that computer . /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will bankrupt app developers, hamper moderation, and exclude blind users from the site. There are many models with many different options. I've tried adjusting various settings several times with no luck. More info: https://rtech. Fallen Order. 85Frequency Penalty=0. So choose one of those depending which model you have. I have installed SillyTavern-extras and run it locally with the configuration --enable-modules=caption,summarize,classify. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with A place to discuss the SillyTavern fork of TavernAI. Now, I'm wondering what my best option for actually running a model is. caplattessdolxaboros-yi-34b-200k-dare-ties-highdensity has a stupid name, but good performance, and there are some good 20b models too such as Noromaid or A place to discuss the SillyTavern fork of TavernAI. While the { style bracket is what NovelAI instruct uses, the memory settings (which the preamble seems to be utilizing, does prefer the [ ] style brackets as suggested in this section of a NovelAI walk through. Models can be good and bad depending on the sampler, instruct, and context settings. But it seems like the Kobold settings in ST have a lot of effect on the outcome too. I have done plenty of googling and doc reading, but I am woefully inexperienced in figuring out this stuff. Just a place to discuss cracks, receive help on cracks, and request software for free. Hidden in there is the Document View, which makes ST's interface less chat-y and more book-y. At this point they can be thought of as Get the Reddit app Scan this QR code to download the app now. the one I am constantly using is Silicon-Maid and I use its recommended settings. Reply reply Bite_It_You_Scum The #1 Reddit source for news, information, and discussion about modern board games and board game culture. 0 bpw exl2 quant and 16k 8 bit ctx (48 gb vram). So I think that repetition is mostly a parameter settings issue. so if you are not experienced or do not know what each setting means, i suggest just I've been encountering a repetition issue with models like Goliath 120b and Xwin 70b on Sillytavern + OpenRouter. Hey all, successfully installed SillyTavern. On PC, navigate to your SillyTavern installation, look for a folder called "public", and copy the folders you want to transfer. Or check it out in the app stores SillyTavern is a fork of TavernAI 1. /r/GuildWars2 is the **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. com for users to share settings and UI files (potentially expanding to other options in the future like character cards). the most i've managed to rack up in charges is like, $2 in one day. SillyTavern supports Dynamic Temperature now and I suggest to try that. We would like to show you a description here but the site won’t allow us. My main question is in regards to the AI response configuration tab (Temperature, Top K, etc. /r/StableDiffusion is back open after the protest of Reddit killing open A place to discuss the SillyTavern fork of TavernAI. 1, Repetition penalty range: 1024, Top P Sampling: 0. however, it is pretty cheap for what it is. In SillyTavern, when I tried a chat with multiple characters (with ChatML settings), characters barely talking anything just short sentences, quite chaotic, but somewhat related. I have imported the recommended as for the other settings, they are important, as they are the quality settings for the AI replies, however usually, models have a sweet spot for these settings, silicon maid for example, on their page, you can find their preferred settings for Silly Tavern. 🙂 silly tavern that I've been just using the default settings aside from using jailbreaks and character notes i find from reddit comments. Thank you. I updated my recommended proxy replacement settings accordingly (see above link). 8 which is under more active development, and has added many major features. While I understand that changing models can have a significant impact, I'm puzzled by the repetition problem. but yeah, it's definitely not free. with the same settings one model may work perfectly while another just spits out a string of words without any punctuation. ai API. ) Installation. Cat-Llama-3-70B-instruct Best settings for SillyTavern . This guide is intended as a complement to the SillyTavern Documentation, not a replacement. My only RP experience this far has been with Replika. yaml file and Hi again! :^D I made this post yesterday, and after playing around with models (more or less), it seems that for my use, Mistral 8x7B is a good choice. As far as the [ ] bracket goes. It can run on an Android **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Log In / Sign Up; Advertise on Reddit phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Attached is a screenshot of my current settings, but I am uncertain about the next steps. Expand user menu Open settings menu. After a few messages, they start producing nonsensical outputs that are only 2-3 sentences long. It behaves way better when there's no example chats. For A place to discuss the SillyTavern fork of TavernAI. A few things I can add to that: SillyTavern is an interface, its requirements are minimal. Members Online A place to discuss the SillyTavern fork of TavernAI. Min. ) and the advanced formatting tab (context templete or instruction templete). Using sillytavern with kobold is dead easy, no problems there. 0 This subreddit has gone Restricted and reference-only as part of a mass protest against Reddit's recent API changes, which break third-party apps and moderation tools. Things like input and output sequence i dont have, same for constrastive search or missing some samplers to prioritize order. Check out our 2K24 Wiki for FAQs, Locker Codes & more. Also settings depend on the version you are using, AFAIK v4 uses chatml format and v3 alpaca. And it gives me very descriptive answers (describing what the character does, wears, thinks etc). Without further ado, I will attach two screenshots of my settings to the post, even though they are almost the same as the ones recommended by the blog. My recommended settings to replace the "simple-proxy-for-tavern" in SillyTavern's latest release: SillyTavern Recommended Proxy Replacement Settings 🆕 UPDATED 2023-08-30! UPDATES: 2023-08-30: SillyTavern 1. If you don't like 8x7b models, though, then my recommendation are the Yi-34b models and finetunes. I may add that one in and see what I get. I would like to ask for advice if I can further tweak my settings in both ST and Koboldcpp to get the most out of it, because to be honest, I just scraped together whatever I could find on other sites without actually knowing how the parameters worked. Click the big A on the top bar of silly tavern and under context template you'll find a most of settings to choose from as well including lighting 1. Both Mixtral 8x7b and Yi34b are very capable too with the right settings. It's just a shame how expensive it can get. 5 Max Temp: 4. for long, descriptive, and slow-paced, OpenAI is probably your best bet. 1 using command-r from open router. However, I am still unclear on how to utilize the summarizer effectively to condense a lengthy conversation into the current context. I noticed a lot of these settings are shared with ooba. The default chatml preset included in sillytavern should have all that if you're up to date. My specs are an Intel I5-9300, 32 gb of ram, GTX 1050 TI If anyone has any models that will provide good output and run well, please share. Join the community and come discuss games like Codenames, Wingspan, Brass, and all A place to discuss the SillyTavern fork of TavernAI. Running Local Models If you want to run local models, treat it like installing Here are my settings for Tavern, not necessarily the best. ADMIN MOD Updated preset & settings for NovelAI Kayra Tutorial 1-3 screenshots - my settings. other simmilar models, is that I would like more dialogue in my responses, does anyone know what I should put in the settings for that, the settings recommended for Noromaid get me 3 As for Settings Presets: If you were a proxy user, there's also a simple-proxy-for-tavern preset that sets temperature and other settings the way the proxy did by default. Advertise on Reddit; Shop Collectible Avatars; Get the Reddit app Scan this QR code to download the app now. Just remember to use the Noromaid context and instruct prompts, as well as the recommended model settings, phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. A place to discuss the SillyTavern fork of TavernAI. As for settings, I recommend taking a look at the Roleplay instruct preset in the latest version of SillyTavern. I used to run mostly "simple-1" but that was ages ago. This sub-reddit is dedicated to everything related to BMW vehicles, tuning, racing, and more. Settings are now backed up automatically every 10 minutes instead of on startup. You can modify the Input Sequence and Output Sequence formats to align better with your chosen model. **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. For samplers the universal presets works good. I'm sharing a collection of presets & settings with the most popular instruct/context templates: Mistral, ChatML, Metharme, Alpaca, LLAMA 3. I've been trying to replicate your SillyTavern settings and such, but i dont have the same amount of options and parameters. Learn more: https://sillytavernai There is a folder named Default in your SillyTavern directory. feels random in the way model writes in group chats and i was wondering if the community managed to find "optimal" settings/strategies to make group chat behave properly so character 1 only **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. (All other sampling methods are disabled) To edit the settings, follow these steps: Navigate to the SillyTavern folder on your computer. SillyTavern is a fork of TavernAI 1. 0 Release! with improved Roleplay and even a proxy preset. Thank you for posting to r/CharacterAI_NSFW!Please be sure to follow our sub's rules, and also check out our Wiki/FAQ information regarding filter bypasses, userscripts, and general CAI guides. Or check it out in the app stores A place to discuss the SillyTavern fork of TavernAI. Should I be changing these settings in ooba or in SillyTavern? which one takes priority? SillyTavern is a fork of TavernAI 1. It's the most preferable model I used, and I've been using it for months. I created a myriad of characters and had some fun. json file. Get the Reddit app Scan this QR code to download the app now. I also have "\n{{user}} " in my stop sequences without the * since I have a few cards that don't italicize actions. Official alternate sub of r/CrackedPlugins3, if that sub ever gets banned, come here. For peoples who use Nous-Capybara-34B with good results, can you share your settings? Help This is the home of the wedding photographer community on Reddit and the place for wedding photographers, second photographers, assistants, and those aspiring to be wedding photographers. And I used this helpful link posted on this reddit by one of you helpful people, for my settings (thanks): What settings and software should I use? I see a lot of people are using kobold instead of oobabooga text-generation-webui. These are the settings in ST: Model: chronos-hermes-13B-GGML Response length: 300 A place to discuss the SillyTavern fork of TavernAI. I wish people that uploaded models would include Sampler, Instruct, and context settings with them that are specifically fine-tuned for them. using llama. Plain min_p settings can be **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Settings and such really depend on which model you are using. We are Reddit's primary hub for all Get the Reddit app Scan this QR code to download the app now is really useful). 2. /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will Expand user menu Open settings menu. At this point they can be thought of as completely independent Best settings for everything( formatting, etc) TTS I guess ( xtts may be the best with emotions etc), downside is it takes up a decent chuck of my vram (6gb) and isn’t that fast) Also, does Not so much as a general guide, but there's lots of short clips to make specific settings changes that I found useful. Right-click on the config. I just procured myself an API key and connected it to SillyTavern's Cohere completion source. 0 Will change if I find better results. Reddit's home for anything and everything related to the NBA 2K series. ST provides a huge set of tools for that. Still working out the details, but for now: Here is some suggested settings (from this post about the update) for making use of the new Roleplay preset, which has been working pretty well for me so far. I use GGUF models with llama. At this point they can be thought of as completely independent programs. This subreddit has been Get the Reddit app Scan this QR code to download the app now. Different samplers affect the output in different ways two different settings could both be good and coherent but you might prefer one over the other more a matter of personal taste. SillyTavern is a Anyway, maybe - before that - try turning the trimming off (a checkbox under context template settings), but that will result in leftovers from the unfinished sentences being So I want to ask the redditor and roleplayer from SillyTavern subreddit about a good settings for that, hope someone can help me! The settings I currently using now is SillyTavern is a fork of TavernAI 1. Like everyone else here, I'm also experimenting with MythoMax 13B. There are a A place to discuss the SillyTavern fork of TavernAI. 65, Repetition penalty: 1. you're paying to use the API through a frontend (like sillytavern, for example), you're not actually hosting it on your computer. Sort by: Best. For those of you using models that allow you to tinker with its settings; what are the values of top p and top k you usually aim for? phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Or find a template of an existing character you like and edit the settings. support Hey. or they just dont look the same. Temp: 0. SillyTavern is a So I've been using SillyTavern for a while now with the Wizard-Vicuna-7B-Uncensored and TheBloke_airoboros-13b-gpt4-GPTQ and it was great at first. Could anyone post the name of the LLM they're using and a screenshot of their Kobold settings in ST? /r/StableDiffusion is back open after the protest of Reddit killing open API access, which will **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. Currently using only temp 1 and min p of . If not though, you can download the template from the sillytavern github at this link for context, and this link for instruct presets, and put them in their respective folders in your sillytavern/public folder. 8Presence Penalty=0. 8Top P=1. It's decent enough for the ERP stuff but if you want something that is good with crazier or maniacal personalities then Claude's Opus seems a bit better for that without tweaking default settings in SillyTavern. Next, connect your Phone to your PC, and enable data transfer. Despite my efforts to find online resources for correct settings, my searches for Auroboros 70b, Xwin 70b, Lzlb 70b, and others have been in vain. SillyTavern is a A place to discuss the SillyTavern fork of TavernAI. Turning off Mirostat sampling fixed my Mixtral repetition problems like magic, so set it to Mode 0 if you haven't already. On ST this settings for MiquMaid-v2-70B have worked perfectly using the Infermatic. cpp as the loader, but **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. What settings could I change to make the role play experience in SillyTavern be the most like Replika? Or if that’s not possible, just the best options I should roll with? Many thanks in advance! **So What is SillyTavern?** Tavern is a user interface you can install on your computer (and Android phones) that allows you to interact text generation AIs and chat/roleplay with characters you or the community create. With example chats it starts writing for my character, without it never does that. it's $0. axcjyq sdrki pjvb rxhaon knhm snnbx wjcl lteen oecvwq kjbjmi