Assessing
Oobabooga Text Generation WebUI — a web interface for running language models locally, with support for different backends and quantization formats.
Tried it as an alternative to Ollama for when you need more control over generation parameters — temperature, top-p, repetition penalty and all the rest, right in the UI, no code required. Handy for experimenting with models: switching quickly, comparing, playing with prompts.
Overkill for production scenarios, but as a tool for exploring and tuning models it's wonderfully hands-on.