mirror of
https://github.com/mauriceboe/TREK.git
synced 2026-10-18 21:16:47 +00:00
fix(admin): say what the local model actually gets
This commit is contained in:
@@ -306,10 +306,9 @@ const DEFAULT_OLLAMA_URL = 'http://localhost:11434/v1'
|
|||||||
|
|
||||||
/** Curated models the local extractor is tuned for, pullable via Ollama. The router drives
|
/** Curated models the local extractor is tuned for, pullable via Ollama. The router drives
|
||||||
* one model per document via Ollama's grammar-constrained `format`; "thinking" is disabled
|
* one model per document via Ollama's grammar-constrained `format`; "thinking" is disabled
|
||||||
* automatically, so the Qwen3 family works without any tuning. A host only needs one — and
|
* automatically, so the Qwen3 family works without any tuning. A host only needs one. */
|
||||||
* Qwen3.5 reads images as well as text, so that one covers every kind of document. */
|
|
||||||
const RECOMMENDED_MODELS: { id: string; label: string; note: string; recommended: boolean; vision: boolean }[] = [
|
const RECOMMENDED_MODELS: { id: string; label: string; note: string; recommended: boolean; vision: boolean }[] = [
|
||||||
{ id: 'qwen3.5:4b', label: 'Qwen3.5 — 4B', note: 'Recommended · reads images as well as text, so one model covers every document (3.4 GB, 256K context, thinking auto-disabled)', recommended: true, vision: true },
|
{ id: 'qwen3.5:4b', label: 'Qwen3.5 — 4B', note: 'Recommended · small and quick on CPU, 3.4 GB download, 256K context (thinking auto-disabled) · Apache-2.0', recommended: true, vision: true },
|
||||||
]
|
]
|
||||||
|
|
||||||
/**
|
/**
|
||||||
|
|||||||
@@ -351,10 +351,9 @@ const DEFAULT_OLLAMA_URL = 'http://localhost:11434/v1'
|
|||||||
|
|
||||||
/** Curated models the local extractor is tuned for, pullable via Ollama. The router drives
|
/** Curated models the local extractor is tuned for, pullable via Ollama. The router drives
|
||||||
* one model per document via Ollama's grammar-constrained `format`; "thinking" is disabled
|
* one model per document via Ollama's grammar-constrained `format`; "thinking" is disabled
|
||||||
* automatically, so the Qwen3 family works without any tuning. A host only needs one — and
|
* automatically, so the Qwen3 family works without any tuning. A host only needs one. */
|
||||||
* Qwen3.5 reads images as well as text, so that one covers every kind of document. */
|
|
||||||
const RECOMMENDED_MODELS: { id: string; label: string; note: string; recommended: boolean; vision: boolean }[] = [
|
const RECOMMENDED_MODELS: { id: string; label: string; note: string; recommended: boolean; vision: boolean }[] = [
|
||||||
{ id: 'qwen3.5:4b', label: 'Qwen3.5 — 4B', note: 'Recommended · reads images as well as text, so one model covers every document (3.4 GB, 256K context, thinking auto-disabled)', recommended: true, vision: true },
|
{ id: 'qwen3.5:4b', label: 'Qwen3.5 — 4B', note: 'Recommended · small and quick on CPU, 3.4 GB download, 256K context (thinking auto-disabled) · Apache-2.0', recommended: true, vision: true },
|
||||||
]
|
]
|
||||||
|
|
||||||
/**
|
/**
|
||||||
|
|||||||
@@ -46,7 +46,7 @@ If you set a provider and model here, it applies to **all users** and overrides
|
|||||||
With the **Local** provider selected, the panel manages your Ollama server directly:
|
With the **Local** provider selected, the panel manages your Ollama server directly:
|
||||||
|
|
||||||
- **Installed on the server** lists the models Ollama already has, with a **Refresh** button. Click a model to select it.
|
- **Installed on the server** lists the models Ollama already has, with a **Refresh** button. Click a model to select it.
|
||||||
- **Pull a recommended model** downloads a model with a live progress bar. The one recommended model is **Qwen3.5 — 4B** (`qwen3.5:4b`, 3.4 GB, 256K context) — it reads images as well as text, so a single download covers every kind of document, and "thinking" is disabled automatically. Once the pull finishes it is selected automatically.
|
- **Pull a recommended model** downloads a model with a live progress bar. The one recommended model is **Qwen3.5 — 4B** (`qwen3.5:4b`, 3.4 GB, 256K context): small and quick on a CPU-only host, "thinking" is disabled automatically, Apache-2.0. Like every local model it receives the document's extracted text, so scanned PDFs still need Anthropic (see below). Once the pull finishes it is selected automatically.
|
||||||
|
|
||||||
You can also select any other model already installed on the server, or type a model id by hand.
|
You can also select any other model already installed on the server, or type a model id by hand.
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user