Skip to main content

​
What the toggle does

On Ultra, turn on Response Streaming in Dashboard -> Verb -> AI Engine. On Discord, WhatsApp, and Telegram, Verba sends the first useful part of a reply as soon as it is available, then edits that same message until the final text is complete. This makes long replies feel faster without leaving duplicate partial messages behind. The completed model response remains the authoritative final message.

​
Supported surfaces

​
Platform streaming vs API streaming

These are two different features:
  • The AI Engine toggle controls platform replies for the connected verb.
  • POST /v1/response with stream: true uses Server-Sent Events (SSE) and is currently an Ultra API feature.
Both currently require Ultra, but enabling one does not enable the other.

​
Reliability behavior

Verba waits for a useful partial sentence before showing the first update and throttles later edits so it does not hammer platform APIs. If a provider cannot stream before anything becomes visible, Verba falls back to the normal single-message response path.
Streaming improves perceived speed; it does not make the model finish sooner. Web search, large context windows, and large outputs can still increase total latency.

​
When to turn it off

  • You only want final, complete messages.
  • A platform or proxy is aggressively rate limiting message edits.
  • Your verb uses multi-message roleplay where separate messages are intentional.

AI engine settings

Configure response streaming, context, reply style, and web search together.