| 126 | # Controls how long the model will stay loaded into memory following the request | 126 | # Controls how long the model will stay loaded into memory following the request |
| 127 | # * -1: Keep the model loaded indefinitely | 127 | # * -1: Keep the model loaded indefinitely |
| 128 | # * 0: Unload the model immediately after the request | 128 | # * 0: Unload the model immediately after the request |
| 129 | # * 5m: Keep the model loaded for 5 minutes after the request. Accepts duration strings (e.g. 5h30m40s) | 129 | # * N (any positive number): Keep the model loaded for N seconds after the request. |
| 130 | keepAlive: -1 | 130 | keepAlive: -1 |
| 131 | # -- ANTHROPIC CLAUDE API CONFIGURATION -- | 131 | # -- ANTHROPIC CLAUDE API CONFIGURATION -- |
| 132 | claude: | 132 | claude: |