Interface ReplyOptions

Source
Expand description

Per-rule streaming options. Merged with server-level defaults, with per-rule values winning.

interface ReplyOptions {
    chunkSize?: number;
    latency?: number;
}

Properties§

§readonly chunkSize?: number

Split text into chunks of this many characters for more realistic streaming.

§readonly latency?: number

Milliseconds to wait between SSE chunks.