| 1610 | </label> | 1606 | </label> |
| 1611 | <label data-tg-type="ooba, aphrodite, tabby" class="checkbox_label flexGrow flexShrink" for="temperature_last_textgenerationwebui"> | 1607 | <label data-tg-type="ooba, aphrodite, tabby" class="checkbox_label flexGrow flexShrink" for="temperature_last_textgenerationwebui"> |
| 1612 | <input type="checkbox" id="temperature_last_textgenerationwebui" /> | 1608 | <input type="checkbox" id="temperature_last_textgenerationwebui" /> |
| 1613 | <label> | 1609 | <small data-i18n="Temperature Last">Temperature Last</small> |
| 1614 | <small data-i18n="Temperature Last">Temperature Last</small> | 1610 | <div class="fa-solid fa-circle-info opacity50p " data-i18n="[title]Temperature_Last_desc" title="Use the temperature sampler last. This is almost always the sensible thing to do. When enabled: sample the set of plausible tokens first, then apply temperature to adjust their relative probabilities (technically, logits). When disabled: apply temperature to adjust the relative probabilities of ALL tokens first, then sample plausible tokens from that. Disabling Temperature Last boosts the probabilities in the tail of the distribution, which tends to amplify the chances of getting an incoherent response."></div> |
| 1615 | <div class="fa-solid fa-circle-info opacity50p " data-i18n="[title]Temperature_Last_desc" title="Use the temperature sampler last. This is almost always the sensible thing to do. When enabled: sample the set of plausible tokens first, then apply temperature to adjust their relative probabilities (technically, logits). When disabled: apply temperature to adjust the relative probabilities of ALL tokens first, then sample plausible tokens from that. Disabling Temperature Last boosts the probabilities in the tail of the distribution, which tends to amplify the chances of getting an incoherent response."></div> | | |
| 1616 | </label> | | |
| 1617 | </label> | 1611 | </label> |
| 1618 | <label data-tg-type="tabby" class="checkbox_label flexGrow flexShrink" for="speculative_ngram_textgenerationwebui"> | 1612 | <label data-tg-type="tabby" class="checkbox_label flexGrow flexShrink" for="speculative_ngram_textgenerationwebui"> |
| 1619 | <input type="checkbox" id="speculative_ngram_textgenerationwebui" /> | 1613 | <input type="checkbox" id="speculative_ngram_textgenerationwebui" /> |
| 1620 | <label> | 1614 | <small data-i18n="Speculative Ngram">Speculative Ngram</small> |
| 1621 | <small data-i18n="Speculative Ngram">Speculative Ngram</small> | 1615 | <div class="fa-solid fa-circle-info opacity50p " data-i18n="[title]Use a different speculative decoding method without a draft model" title="Use a different speculative decoding method without a draft model. Using a draft model is preferred. Speculative ngram is not as effective."></div> |
| 1622 | <div class="fa-solid fa-circle-info opacity50p " data-i18n="[title]Use a different speculative decoding method without a draft model" title="Use a different speculative decoding method without a draft model. Using a draft model is preferred. Speculative ngram is not as effective."></div> | | |
| 1623 | </label> | | |
| 1624 | </label> | 1616 | </label> |
| 1625 | | | |
| 1626 | <label data-tg-type="vllm, aphrodite, infermaticai" class="checkbox_label" for="spaces_between_special_tokens_textgenerationwebui"> | 1617 | <label data-tg-type="vllm, aphrodite, infermaticai" class="checkbox_label" for="spaces_between_special_tokens_textgenerationwebui"> |
| 1627 | <input type="checkbox" id="spaces_between_special_tokens_textgenerationwebui" /> | 1618 | <input type="checkbox" id="spaces_between_special_tokens_textgenerationwebui" /> |
| 1628 | <small data-i18n="Spaces Between Special Tokens">Spaces Between Special Tokens</small> | 1619 | <small data-i18n="Spaces Between Special Tokens">Spaces Between Special Tokens</small> |